-- Logs begin at Tue 2022-05-17 16:08:08 UTC, end at Tue 2022-05-17 17:46:10 UTC. -- May 17 17:12:45.073845 dv-cinder-842142-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 17 17:12:45.080973 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 17 17:12:45.082935 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 17 17:12:45 2022] *** May 17 17:12:45.082935 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 17 17:12:45.082935 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 17 17:12:45.082935 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: nodename: dv-cinder-842142-1-iscsi May 17 17:12:45.082935 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: machine: x86_64 May 17 17:12:45.082935 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: clock source: unix May 17 17:12:45.082935 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: pcre jit disabled May 17 17:12:45.083456 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: detected number of CPU cores: 4 May 17 17:12:45.083456 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: current working directory: / May 17 17:12:45.083456 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: detected binary path: /usr/bin/uwsgi-core May 17 17:12:45.083456 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: your processes number limit is 47680 May 17 17:12:45.083456 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: your memory page size is 4096 bytes May 17 17:12:45.083456 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: detected max file descriptor number: 2048 May 17 17:12:45.083456 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: lock engine: pthread robust mutexes May 17 17:12:45.083456 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: thunder lock: enabled May 17 17:12:45.083456 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 17 17:12:45.083456 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 17 17:12:45.128907 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: Python main interpreter initialized at 0x560b1042a9c0 May 17 17:12:45.128907 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: python threads support enabled May 17 17:12:45.128907 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: your server socket listen backlog is limited to 100 connections May 17 17:12:45.128907 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: your mercy for graceful operations on workers is 90 seconds May 17 17:12:45.129277 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: mapped 403077 bytes (393 KB) for 2 cores May 17 17:12:45.129354 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: *** Operational MODE: preforking *** May 17 17:12:45.129617 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: *** uWSGI is running in multiple interpreter mode *** May 17 17:12:45.129617 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: spawned uWSGI master process (pid: 103255) May 17 17:12:45.129810 dv-cinder-842142-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 17 17:12:45.135539 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: spawned uWSGI worker 1 (pid: 103256, cores: 1) May 17 17:12:45.135539 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: spawned uWSGI worker 2 (pid: 103257, cores: 1) May 17 17:12:45.135539 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 17 17:12:46.317910 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 17 17:12:46.325784 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 17 17:12:47.040541 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 17:12:47.040541 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: from cryptography.utils import int_from_bytes May 17 17:12:47.040864 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 17:12:47.040864 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: from cryptography.utils import int_from_bytes May 17 17:12:47.045098 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 17:12:47.045098 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: from cryptography.utils import int_from_bytes May 17 17:12:47.045423 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 17:12:47.045423 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: from cryptography.utils import int_from_bytes May 17 17:12:49.638650 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 17:12:49.639198 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 17:12:49.639434 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 17:12:49.639827 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 17:12:49.640087 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 17:12:49.640481 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.640813 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.641139 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.641464 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.641801 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.642118 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.642443 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.642766 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.643099 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.643358 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.643713 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.643872 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 17:12:49.644246 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842142-1-iscsi {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.644338 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 17:12:49.644426 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.644643 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 17:12:49.644739 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.644971 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.645054 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 17:12:49.645246 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 17:12:49.645331 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.645587 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.645683 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.645913 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.646001 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.646227 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.646325 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.646561 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.646721 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.646893 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.647176 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.647293 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.647489 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.647609 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.647826 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.647920 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.648163 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.648261 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.648421 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.648506 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.648740 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.648850 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.649067 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842142-1-iscsi {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.649181 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.649387 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.649499 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.649696 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.649801 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.650010 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.650107 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.650325 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.650413 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842142-1-iscsi {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.650632 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.650727 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.650956 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.651564 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.651802 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.651900 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.652297 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.652387 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.652612 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.652739 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.652922 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.653015 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.653235 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.653328 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.653571 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.653667 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.653881 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.653972 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.654191 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.654282 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.654511 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.654596 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.654824 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.654919 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.655145 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.655229 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.655451 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.655559 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.655790 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.655884 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842142-1-iscsi {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.656106 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.656202 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.656427 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.656514 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.656735 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.656828 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.657045 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.657179 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.657563 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.657759 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.657874 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.658080 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.658221 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.658401 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.658546 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.658725 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.658858 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.659034 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.659120 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.659346 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.659439 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.659693 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.659791 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.660005 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.660105 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.660321 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.660422 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.660620 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.660704 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.660927 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.661024 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.661235 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.661320 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.661541 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.661625 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.661846 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.662014 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.662152 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.662244 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.662398 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.662482 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.662705 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.662800 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.663024 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.663110 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.663346 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.663432 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.663695 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.663788 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.663949 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.664053 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.664199 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.664402 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.88 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.664518 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.664654 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.88 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.664837 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.664964 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.665143 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.665304 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.665451 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.665623 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.665758 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.665932 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.666063 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.666257 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.666355 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.666577 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.667272 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.667446 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.667552 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.667786 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.667873 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.668096 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.668188 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.668419 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.668505 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.668746 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.668833 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.669056 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.669140 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.669310 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.669402 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.669615 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.669754 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.88 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.669922 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.670010 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.88 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.670242 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.670351 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.670552 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.670656 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.670856 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.670943 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.671165 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.671258 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.671468 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.671582 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.671801 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.671886 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.672109 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.672211 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.672417 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.672507 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.672722 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.672818 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.673031 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.673129 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.673335 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.673466 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.673643 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.673728 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.673889 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.673974 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.674193 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.674287 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.674498 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.674591 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.674815 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.674909 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.675124 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.675247 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.675431 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.675560 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.675762 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.675855 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.676064 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.676165 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.676370 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.676461 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.676675 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.676766 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.676981 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.677077 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.677283 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.677373 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.677594 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.677685 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.677896 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.677987 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.678201 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.678292 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.678505 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.678595 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.678810 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.678907 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.679126 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.679228 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.679426 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.679544 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.679760 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.679865 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.680065 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.680178 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.680370 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.680459 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.680674 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.680761 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.680981 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.681078 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.681284 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.681367 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.681586 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.681669 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.681895 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.681993 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.682198 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.682299 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.682526 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.682622 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.682829 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.682923 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.683134 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.683218 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.683440 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.683592 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.683776 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.683874 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.684078 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.684162 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.684382 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.684465 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.684696 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.684789 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.685003 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.685088 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.685308 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.685393 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.685612 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.685705 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.685916 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.686002 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.686220 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.686305 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.686525 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.686623 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.686824 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.686919 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.687125 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.687220 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.687432 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.687556 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.687773 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.687889 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.688091 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.688189 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.688401 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.688508 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.688706 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.688824 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.689010 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.689170 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.689327 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:12:49.689453 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.689663 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.689785 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.689993 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.690107 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.690334 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.690422 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.690648 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.690775 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.690978 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.691065 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.691307 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.691392 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.691651 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.691741 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.691966 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.692066 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.692281 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.692367 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.692607 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.692694 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.692921 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.693015 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.693233 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.693326 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.693546 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.693674 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.693864 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.693951 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.694180 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.694265 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.694493 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.694576 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.694811 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.694897 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.695124 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.695215 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.695442 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.695552 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.695777 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.695864 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.696094 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.696187 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.696409 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.696492 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.696727 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.696821 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.697040 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.697131 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.697354 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.697445 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.697673 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.697759 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.698038 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.698123 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.698361 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.698459 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.698681 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.698766 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.698993 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.699076 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.699307 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.699400 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.699643 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.699747 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.699958 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.700042 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.700274 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.700368 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.700585 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.700670 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.700896 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.700980 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.701206 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.701292 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.701517 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.701601 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.701823 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.701907 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.702134 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.702219 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.702446 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.702531 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.702760 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.702843 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.703087 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.703179 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.703396 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.703479 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.703733 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.703817 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.704047 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.704139 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.704357 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.704441 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.704667 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.704758 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.704978 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.705061 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.705283 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.705375 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.705590 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.705683 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.705897 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.705990 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.706208 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.706300 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.706513 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.706606 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.706836 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.706921 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.707145 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.707229 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.707459 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.707576 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.707816 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.707902 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.708124 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.708216 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.708435 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.708529 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.708745 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.708837 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.709057 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.709142 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.709364 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.709458 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.709674 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.709759 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.709985 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.710152 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.710294 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.710378 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.710617 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.710703 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.710928 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.711013 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.711234 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.711332 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.711578 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.711669 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.711889 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.712056 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.712197 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.712282 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.712510 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.712594 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.712818 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.712911 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.713127 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.713211 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.713433 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.714011 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.714255 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.714352 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.714563 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.714647 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.714871 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.714956 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.715179 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.715273 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.715488 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.715646 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.715817 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.715903 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.716143 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.716230 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.716455 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.716539 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.716761 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.716888 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.717068 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.717162 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.717374 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.717459 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.717686 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.717806 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.717995 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.718092 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.718302 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.718395 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.718608 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.718694 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.718917 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.719005 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.719223 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.719310 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.719561 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.719664 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.719853 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.719940 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.720160 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.720246 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.720465 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.720559 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.720788 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.720883 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.721098 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.721185 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.721403 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.721504 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.721709 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.721794 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.722013 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.722098 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.722339 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.722430 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.722648 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.722740 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.722965 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.723049 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.723289 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.723422 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.723624 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.723725 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.723946 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.724039 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.724266 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.724352 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.724583 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.724668 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.724897 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.724982 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.725210 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.725296 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.725521 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.725606 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.725833 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.725919 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.726145 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.726231 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.726455 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.726541 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.726766 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.726849 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.727080 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.727167 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.727401 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.727486 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.727737 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.727833 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.728056 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.728143 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.728362 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.728447 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.728677 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.728771 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.728988 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.729079 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.729841 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.729945 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.730153 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.730248 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.730471 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.730559 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.730786 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.730879 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.731103 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.731198 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.731416 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.731527 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.731753 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.731889 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.732062 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.732150 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.732375 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.732468 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.732685 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.732769 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.732993 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.733078 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.733298 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.733382 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.733606 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.733690 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.733915 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.734000 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.734224 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.734344 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.734536 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.734620 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.734838 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.734930 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.735142 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.735225 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.735459 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.735591 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.735794 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.735882 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.736100 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.736185 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.736405 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.736499 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.736719 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.736804 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.737031 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.737114 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.737341 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.737437 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.737653 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.737741 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.737961 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.738048 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.738268 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.738362 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.738574 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.738658 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.738886 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.738978 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.739196 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.739296 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.739504 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.739681 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.739834 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.739927 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.740141 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.740226 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.740448 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.740532 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.740750 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.740838 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.741054 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.741141 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.741362 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.741448 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.741682 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.741777 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.741992 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.742081 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.742309 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.742401 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.742622 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.742714 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.742926 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.743012 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.743230 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.743322 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.743569 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.743675 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.743880 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.743976 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.744186 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.744272 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.744490 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.744585 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.744826 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.744954 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.745141 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.745304 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.745468 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.745618 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.745781 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.745924 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.746094 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.746240 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.746407 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.746563 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.746715 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.746878 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.747028 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.747193 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.747385 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.747502 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.747834 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.748059 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.748147 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.748402 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.748495 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.748728 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.748812 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.749051 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.749135 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.749361 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.749460 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.749670 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.749755 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.749981 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.750066 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.750302 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.750396 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.750611 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.750696 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.750922 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.751016 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.751235 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.751320 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.751564 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.751654 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.751880 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.751965 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.752195 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.752281 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.752509 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.752752 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.752845 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.753088 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.753174 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.753407 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.753494 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.753715 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.753799 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.754025 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.754109 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.754334 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.754421 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.754646 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.754734 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.754965 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.755050 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.755275 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.755361 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.755611 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.755713 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.755923 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.756008 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.756235 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.756328 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.756546 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.756633 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.756852 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.756935 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.757161 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.757298 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.757467 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.757553 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.757775 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.757858 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.758087 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.758181 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.758395 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.758481 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.758700 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.758785 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.759003 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.759097 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.759309 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.759401 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.759648 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.759737 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.759957 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.760045 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.760271 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.760394 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.760605 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.760691 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.760931 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.761026 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.761244 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.761330 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.761550 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.761645 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.761857 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.761951 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.762161 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.762245 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.762470 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.762562 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.762785 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.762870 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.763097 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.763183 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.763405 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.763502 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.763741 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.763828 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.764051 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.764136 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.764368 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.764466 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.764680 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.764765 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.764984 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.765067 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.765288 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.765380 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.765589 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.765717 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.765897 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.765989 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.766205 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.766299 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.766509 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.766595 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.766812 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.766902 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.767119 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.767204 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.767430 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.767533 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.767764 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.767862 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.768066 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.768154 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.768377 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.768462 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.768682 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.768780 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.768988 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.769073 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.769295 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.769387 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.769602 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.769696 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.769904 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.769990 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.770209 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.770301 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.770515 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.770609 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.770820 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.770905 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.771126 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.771221 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.771427 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.771565 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.771771 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.771865 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.772075 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.772161 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.772378 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.772465 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.772683 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.772768 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.772988 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.773078 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.773294 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.773380 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.773596 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.773688 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.773904 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.773989 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.774211 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.774297 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.774512 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.774603 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.774815 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.774902 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.775121 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.775215 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.775425 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.775538 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.775754 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.775853 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.776598 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.776891 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.776891 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.777083 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.777199 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.777299 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.777507 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.777593 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.777819 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.777913 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.778123 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.778217 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.778429 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.778514 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.778732 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.778818 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.779037 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.779133 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.779342 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.779435 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.779672 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.779760 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.779977 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.780065 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.780281 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.780366 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.780585 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.780679 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.780906 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.781004 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.781213 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.781305 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.781517 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.781616 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.781822 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.781908 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.782122 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.782205 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.782704 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.782789 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.783013 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.783098 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.783324 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.783408 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.783670 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.783772 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.783993 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.784088 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.784309 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.784402 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.784614 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.784708 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.784922 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.785013 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.785234 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.785317 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.785536 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.785633 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.785847 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.785931 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.786154 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.786238 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.786464 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.786558 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.786769 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.786855 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.787077 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.787168 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.787392 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.787488 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.787727 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.787812 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.788034 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.788118 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.788351 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.788439 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.788663 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.788748 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.788972 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.789057 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.789276 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.789368 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.789585 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.789677 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.789895 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.789980 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.790204 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.790290 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.790512 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.790597 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.790820 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.790904 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.791132 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.791219 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.791444 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.791577 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.792338 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.792483 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.792652 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.792857 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.792964 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.793181 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.793268 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.793500 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.793587 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.793817 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.793902 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.794139 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.794226 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.794459 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.794546 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.794766 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.794861 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.795075 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.795199 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.795385 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.795534 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.795715 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.795859 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.796025 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.796195 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.796330 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.796472 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.796761 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.796855 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.797073 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.797168 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.797389 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.797475 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.797694 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.797822 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.798003 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.798102 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.798312 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.798398 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.798625 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.798717 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.798938 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.799030 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.799241 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.799332 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.799679 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.799770 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.799996 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.800084 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.800307 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.800423 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.800619 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.800849 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.800943 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.801167 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.801252 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.801481 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.801566 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.801806 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.801912 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.802127 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.802212 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.802434 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.802520 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.802740 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.802835 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.803056 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.803142 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.803358 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.803443 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.803706 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.803796 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.804031 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.804117 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.804347 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.804432 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.804664 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.804751 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.804971 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.805115 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.805297 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.805408 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.805622 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.805707 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.805939 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.806025 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.806263 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.806348 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.806641 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.806733 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.806947 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.807073 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.807289 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.807440 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.807635 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.807794 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.807963 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.808146 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.808286 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.808483 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.808595 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.808794 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.808909 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.809110 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.809202 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.809420 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.809525 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.809729 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.809858 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.810055 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.810174 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.810366 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.810495 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.810702 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.810908 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.811083 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.811234 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.811386 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.811549 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.811722 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.811878 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.812031 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.812204 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.812367 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.812512 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.812700 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.812818 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.813046 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.813132 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.813389 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.813484 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.813712 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.813804 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.814033 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.814119 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.814337 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.814431 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.814648 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.814733 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.814956 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.815043 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.815262 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.815356 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.815586 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.815675 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.815890 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.815981 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.816210 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.816299 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.816514 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.816601 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.816834 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.816919 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.817152 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.817239 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.817470 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.817557 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.817809 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.817904 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.818090 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.818176 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.818410 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.818496 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.818719 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.818813 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.819025 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.819118 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.819330 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.819416 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.819660 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.819762 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.820000 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.820095 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.820306 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.820399 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.820626 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.820721 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.820953 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.821037 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.821266 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.821353 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.821579 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.821673 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.821884 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.821976 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.822194 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.822289 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.822502 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.822590 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.822828 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.822939 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.823163 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.823249 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.823474 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.823581 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.823809 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.823896 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.824119 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.824217 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.824424 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.824510 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.824732 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.824815 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.825035 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.825118 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.825346 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.825434 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.825653 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.825738 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.825958 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.826054 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.826263 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.826349 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.826586 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.826672 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.826894 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.826988 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.827222 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.827354 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.827562 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.827707 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.827863 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.828031 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.828172 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.828350 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.828477 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.828673 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.828815 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.828991 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.829119 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.829308 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.829452 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.829625 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.829769 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.829939 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.830093 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.830257 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.830425 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.830576 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.830733 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.830896 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.831057 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.831373 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.831459 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.831716 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.831813 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.832035 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.832122 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.832352 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.832438 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.832668 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.832762 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.832984 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.833069 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.833299 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.833384 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.833610 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.833697 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.833924 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.834010 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.834240 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.834325 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.834556 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.834643 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.834927 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.835074 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.835254 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.835403 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.835610 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.835747 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.835950 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.836059 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.836271 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.836480 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.836593 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.836679 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.836913 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.836999 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.837233 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.837328 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.837576 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.837663 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.837888 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.837974 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.838196 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.838289 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.839042 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.839137 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.839371 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.839466 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.839712 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.839799 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.840052 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.840196 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.840372 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.840514 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.840690 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.840971 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.841155 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.841296 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.841483 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.841635 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.841842 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.841952 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.842160 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.842275 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.842471 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.842596 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.842787 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.842926 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.843103 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.843263 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.843419 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.843611 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.843765 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.843935 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.844078 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.844257 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.844394 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.844578 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.844707 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.845016 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.845122 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.845327 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.845442 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.845643 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.845781 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.845960 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.846112 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.846284 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.846442 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.846618 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.846761 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.846940 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.847082 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.847255 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.847413 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.847594 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.847749 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.847920 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.848061 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.848378 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.848471 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.848715 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.848801 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.849026 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.849119 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.849356 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.849443 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.849671 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.849764 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.849980 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.850072 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.850303 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.850397 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.850617 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.850710 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.850925 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.851153 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.851247 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.851501 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.851611 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.851840 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.851927 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.852145 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.852232 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.852466 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.852553 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.852777 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.852870 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.853083 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.853170 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.853405 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.853527 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.853715 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.853800 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.854028 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.854791 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.854912 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.855145 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.855231 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.855470 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.855620 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.855838 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.855924 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.856154 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.856241 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.856468 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.856563 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.856777 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.856863 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.857091 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.857176 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.857398 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.857491 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.857711 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.857796 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.858028 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.858114 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.858342 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.858435 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.858647 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.858732 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.858954 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.859054 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.859265 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.859352 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.859594 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.859682 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.859902 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.859996 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.860213 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.860299 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.860518 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.860610 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.860830 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.860922 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.861138 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.861229 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.861445 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.861528 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.861780 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.861880 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.862056 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.862143 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.862361 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.862446 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.862668 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.862755 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.862973 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.863058 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.863280 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.863365 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.863619 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.863709 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.863927 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.864013 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.864239 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.864325 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.864546 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.864635 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.864857 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.864942 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.865163 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.865248 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.865473 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.865568 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.865814 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.865910 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.866136 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.866353 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.866441 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.866693 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.866780 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.867019 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.867112 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.867331 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.867419 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.867686 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.867790 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.868001 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.868088 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.868310 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.868396 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.868621 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.868706 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.868958 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.869042 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.869280 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.869486 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.869594 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.869846 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.869936 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.870168 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.870256 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.870501 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.870586 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.870832 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.870919 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.871140 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.871227 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.871448 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.871554 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.871788 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.871873 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.872102 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.872190 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.872413 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.872541 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.872726 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.872823 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.873038 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.873123 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.873349 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.873435 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.873660 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.873755 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.873970 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.874056 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.874279 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.874366 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.874589 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.874687 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.874897 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.874984 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.875207 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.875295 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.875564 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.875668 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.875847 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.875934 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.876158 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.876245 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.876487 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.876586 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.876804 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.876889 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.877114 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.877206 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.877428 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.877541 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.877748 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.877861 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.878059 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.878186 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.878386 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.878511 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.878698 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.878825 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.879008 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.879157 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.879322 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.879486 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.879676 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.879828 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.879991 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.880156 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.880299 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.880470 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.880720 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.880813 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.881037 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.881156 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.881359 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.881491 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.881683 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.881819 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.881999 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.882133 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.882339 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.882434 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.882663 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.882750 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.882979 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.883066 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.883303 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.883396 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.883641 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.883732 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.883973 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.884061 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.884304 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.884387 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.884621 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.884715 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.884931 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.885024 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.885241 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.885327 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.885573 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.885672 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.885882 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.885967 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.886193 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.886314 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.886499 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.886594 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.886809 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.886930 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.887114 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.887207 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.887421 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.887533 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.887755 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.887852 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.888061 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.888146 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.888369 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.888457 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.888675 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.888759 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.888979 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.889064 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.889290 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.889378 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.889596 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.889687 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.889904 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.889988 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.890208 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.890294 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.890513 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.890598 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.890819 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.890904 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.891125 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.891219 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.891435 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.891548 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.891769 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.891867 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.892076 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.892163 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.892382 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.892468 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.892688 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.892782 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.892991 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.893077 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.893321 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.893414 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.893652 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.893747 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.893964 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.894049 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.894283 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.894369 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.894596 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.894690 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.894909 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.894995 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.895217 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.895302 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.895545 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.895646 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.895869 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.895954 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.896186 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.896281 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.896495 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.896588 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.896823 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.896909 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.897133 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.897220 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.897443 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.897532 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.897760 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.897846 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.898071 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.898166 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.898382 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.898468 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.898692 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.898827 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.899003 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.899101 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.899328 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.899421 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.899657 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.899744 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.899982 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.900076 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.900298 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.900382 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.900615 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.900699 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.900930 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.901523 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.901756 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.901842 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.902088 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.902183 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.902402 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.902496 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.902711 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.902805 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.903027 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.903113 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.903339 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.903428 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.903674 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.903780 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.903992 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.904087 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.904308 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.904404 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.904634 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.904720 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.904946 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.905043 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.905191 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 17:12:49.905278 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.905570 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.905895 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.906241 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.906556 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.906896 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.907480 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.907828 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.908147 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.908454 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:12:49.908697 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 17:12:49.929052 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG oslo_db.sqlalchemy.engines [None req-e610defd-e48b-4a69-b439-acf94cd72f7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:12:49.932076 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG oslo_db.sqlalchemy.engines [None req-26d9c296-7dcd-48ab-bcff-1b2943a16ea3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103257) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:12:49.992776 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.context [None req-e610defd-e48b-4a69-b439-acf94cd72f7c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),598e0022-4d13-47ae-9073-352b20e59bd0(cell1) {{(pid=103256) load_cells /opt/stack/nova/nova/context.py:464}} May 17 17:12:49.994487 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.context [None req-26d9c296-7dcd-48ab-bcff-1b2943a16ea3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),598e0022-4d13-47ae-9073-352b20e59bd0(cell1) {{(pid=103257) load_cells /opt/stack/nova/nova/context.py:464}} May 17 17:12:49.997185 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-e610defd-e48b-4a69-b439-acf94cd72f7c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:49.998784 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG oslo_concurrency.lockutils [None req-26d9c296-7dcd-48ab-bcff-1b2943a16ea3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:49.998880 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-e610defd-e48b-4a69-b439-acf94cd72f7c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:49.999605 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-e610defd-e48b-4a69-b439-acf94cd72f7c None None] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:50.000379 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG oslo_concurrency.lockutils [None req-26d9c296-7dcd-48ab-bcff-1b2943a16ea3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:50.001170 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG oslo_concurrency.lockutils [None req-26d9c296-7dcd-48ab-bcff-1b2943a16ea3 None None] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:12:50.001511 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-e610defd-e48b-4a69-b439-acf94cd72f7c None None] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:50.003073 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG oslo_concurrency.lockutils [None req-26d9c296-7dcd-48ab-bcff-1b2943a16ea3 None None] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:12:50.012603 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG oslo_db.sqlalchemy.engines [None req-e610defd-e48b-4a69-b439-acf94cd72f7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:12:50.016662 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG oslo_db.sqlalchemy.engines [None req-26d9c296-7dcd-48ab-bcff-1b2943a16ea3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103257) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:12:50.019250 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG oslo_db.sqlalchemy.engines [None req-26d9c296-7dcd-48ab-bcff-1b2943a16ea3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103257) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:12:50.023084 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG oslo_db.sqlalchemy.engines [None req-e610defd-e48b-4a69-b439-acf94cd72f7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:12:50.180245 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG oslo_db.sqlalchemy.engines [None req-e610defd-e48b-4a69-b439-acf94cd72f7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:12:50.183670 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG oslo_db.sqlalchemy.engines [None req-26d9c296-7dcd-48ab-bcff-1b2943a16ea3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103257) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:12:50.604871 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: WARNING keystonemiddleware.auth_token [None req-e610defd-e48b-4a69-b439-acf94cd72f7c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 17:12:50.612139 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: WARNING keystonemiddleware.auth_token [None req-e610defd-e48b-4a69-b439-acf94cd72f7c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 17:12:50.624499 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: WARNING keystonemiddleware.auth_token [None req-26d9c296-7dcd-48ab-bcff-1b2943a16ea3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 17:12:50.632698 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: WARNING keystonemiddleware.auth_token [None req-26d9c296-7dcd-48ab-bcff-1b2943a16ea3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 17:12:50.962403 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: WARNING keystonemiddleware.auth_token [None req-e610defd-e48b-4a69-b439-acf94cd72f7c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 17:12:50.969082 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: WARNING keystonemiddleware.auth_token [None req-e610defd-e48b-4a69-b439-acf94cd72f7c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 17:12:50.973540 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: WARNING keystonemiddleware.auth_token [None req-26d9c296-7dcd-48ab-bcff-1b2943a16ea3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 17:12:50.975077 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560b1042a9c0 pid: 103256 (default app) May 17 17:12:50.977187 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-e610defd-e48b-4a69-b439-acf94cd72f7c None None] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:12:50.978372 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-e610defd-e48b-4a69-b439-acf94cd72f7c None None] 10.222.0.88 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001732 May 17 17:12:50.978788 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 1/1] 10.222.0.88 () {50 vars in 788 bytes} [Tue May 17 17:12:50 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:12:50.980467 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: WARNING keystonemiddleware.auth_token [None req-26d9c296-7dcd-48ab-bcff-1b2943a16ea3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 17:12:50.985519 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560b1042a9c0 pid: 103257 (default app) May 17 17:14:11.718965 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-e610defd-e48b-4a69-b439-acf94cd72f7c None None] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:11.720053 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-e610defd-e48b-4a69-b439-acf94cd72f7c None None] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 May 17 17:14:11.722051 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 2/2] 10.222.0.88 () {54 vars in 930 bytes} [Tue May 17 17:14:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:14:12.143222 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-e4a91999-c274-43cc-945b-98fa55fb6ea9 admin admin] Calling method '>' {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:12.173144 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-e4a91999-c274-43cc-945b-98fa55fb6ea9 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.446084 May 17 17:14:12.183580 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 1/3] 10.222.0.88 () {60 vars in 1291 bytes} [Tue May 17 17:14:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:14:14.430958 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-e610defd-e48b-4a69-b439-acf94cd72f7c None None] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:14.432064 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-e610defd-e48b-4a69-b439-acf94cd72f7c None None] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 May 17 17:14:14.432476 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 3/4] 10.222.0.88 () {54 vars in 930 bytes} [Tue May 17 17:14:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:14:14.491578 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-e003050d-11a4-413b-8150-8ac4123b0ee4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "id": "c1", "disk": 1, "ram": 256, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:14.509874 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 17:14:14.509874 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: warnings.warn(msg) May 17 17:14:14.618517 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-e003050d-11a4-413b-8150-8ac4123b0ee4 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.180134 May 17 17:14:14.623626 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 2/5] 10.222.0.88 () {64 vars in 1282 bytes} [Tue May 17 17:14:14 2022] POST /compute/v2.1/flavors => generated 407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 17:14:14.841805 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-bba9e058-c09e-4b93-879f-0123b33a0c30 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:14.844679 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 17:14:14.844679 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: warnings.warn(msg) May 17 17:14:14.952396 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-bba9e058-c09e-4b93-879f-0123b33a0c30 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.324363 May 17 17:14:14.953379 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 4/6] 10.222.0.88 () {64 vars in 1335 bytes} [Tue May 17 17:14:14 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:14:17.204903 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-e003050d-11a4-413b-8150-8ac4123b0ee4 admin admin] Calling method '>' {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:17.205903 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-e003050d-11a4-413b-8150-8ac4123b0ee4 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 May 17 17:14:17.206301 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 3/7] 10.222.0.88 () {54 vars in 930 bytes} [Tue May 17 17:14:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:14:17.308739 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-3359895f-32ac-4147-8b86-28b43629ee8b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "rxtx_factor": 1.0, "disk": 5, "swap": 0}} {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:17.326951 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 17:14:17.326951 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: warnings.warn(msg) May 17 17:14:17.437549 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-3359895f-32ac-4147-8b86-28b43629ee8b admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.225551 May 17 17:14:17.438134 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 5/8] 10.222.0.88 () {64 vars in 1282 bytes} [Tue May 17 17:14:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 17:14:17.449888 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-1992cac9-2133-4aa1-b7b3-4ba83c6ed289 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:17.451430 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 17:14:17.451430 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: warnings.warn(msg) May 17 17:14:17.565182 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-1992cac9-2133-4aa1-b7b3-4ba83c6ed289 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119117 May 17 17:14:17.565954 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 4/9] 10.222.0.88 () {64 vars in 1335 bytes} [Tue May 17 17:14:17 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:19.848845 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-3359895f-32ac-4147-8b86-28b43629ee8b admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:19.849813 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-3359895f-32ac-4147-8b86-28b43629ee8b admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 17 17:14:19.851018 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 6/10] 10.222.0.88 () {54 vars in 930 bytes} [Tue May 17 17:14:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:14:19.918509 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-0e354d2b-5417-479f-9a34-a7df75b2135f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "id": "d2", "rxtx_factor": 1.0, "swap": 0, "disk": 10}} {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:19.983640 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-0e354d2b-5417-479f-9a34-a7df75b2135f admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.126830 May 17 17:14:19.984303 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 5/11] 10.222.0.88 () {64 vars in 1282 bytes} [Tue May 17 17:14:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 17:14:19.996985 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-953e07f8-57b7-4088-96a9-b83d092cf426 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:20.103351 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-953e07f8-57b7-4088-96a9-b83d092cf426 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.110628 May 17 17:14:20.104308 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 7/12] 10.222.0.88 () {64 vars in 1335 bytes} [Tue May 17 17:14:19 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:22.403384 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-0e354d2b-5417-479f-9a34-a7df75b2135f admin admin] Calling method '>' {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:22.404455 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-0e354d2b-5417-479f-9a34-a7df75b2135f admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 May 17 17:14:22.404862 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 6/13] 10.222.0.88 () {54 vars in 930 bytes} [Tue May 17 17:14:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:14:22.462011 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-992ed712-3a0b-4c8e-8c19-e1ddbfa9b676 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "d3", "rxtx_factor": 1.0, "disk": 10}} {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:22.534783 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-992ed712-3a0b-4c8e-8c19-e1ddbfa9b676 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.123829 May 17 17:14:22.535652 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 8/14] 10.222.0.88 () {64 vars in 1282 bytes} [Tue May 17 17:14:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 17:14:22.548300 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-b8827821-fa81-4c51-b475-be493eff8b55 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:22.629918 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-b8827821-fa81-4c51-b475-be493eff8b55 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085361 May 17 17:14:22.630144 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 7/15] 10.222.0.88 () {64 vars in 1335 bytes} [Tue May 17 17:14:22 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:24.866716 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-992ed712-3a0b-4c8e-8c19-e1ddbfa9b676 admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:24.867805 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-992ed712-3a0b-4c8e-8c19-e1ddbfa9b676 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 May 17 17:14:24.868203 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 9/16] 10.222.0.88 () {54 vars in 930 bytes} [Tue May 17 17:14:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:14:24.925535 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-a72443e8-4a01-4ae8-9b60-144dafbbd346 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "ram": 4096, "id": "d4", "rxtx_factor": 1.0}} {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:25.024788 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-a72443e8-4a01-4ae8-9b60-144dafbbd346 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.150846 May 17 17:14:25.026140 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 8/17] 10.222.0.88 () {64 vars in 1282 bytes} [Tue May 17 17:14:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 17:14:25.038239 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-868f9634-c8c4-4024-bf62-a4b3932a8856 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:25.166188 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-868f9634-c8c4-4024-bf62-a4b3932a8856 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131713 May 17 17:14:25.166943 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 10/18] 10.222.0.88 () {64 vars in 1335 bytes} [Tue May 17 17:14:25 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:27.425970 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-a72443e8-4a01-4ae8-9b60-144dafbbd346 admin admin] Calling method '>' {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:27.426901 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-a72443e8-4a01-4ae8-9b60-144dafbbd346 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 May 17 17:14:27.427302 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 9/19] 10.222.0.88 () {54 vars in 930 bytes} [Tue May 17 17:14:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:14:27.486386 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-c5f796cd-7c12-46c4-9e27-ebef8e97698f admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:27.510481 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-c5f796cd-7c12-46c4-9e27-ebef8e97698f admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076318 May 17 17:14:27.511354 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 11/20] 10.222.0.88 () {60 vars in 1291 bytes} [Tue May 17 17:14:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:14:29.837786 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-a72443e8-4a01-4ae8-9b60-144dafbbd346 admin admin] Calling method '>' {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:29.838818 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-a72443e8-4a01-4ae8-9b60-144dafbbd346 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 May 17 17:14:29.839225 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 10/21] 10.222.0.88 () {54 vars in 930 bytes} [Tue May 17 17:14:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:14:29.905578 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-5a3a8e80-9996-41d1-9c54-6aee9e3352d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.tiny", "vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1}} {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:29.985310 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-5a3a8e80-9996-41d1-9c54-6aee9e3352d4 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.139533 May 17 17:14:29.986000 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 12/22] 10.222.0.88 () {64 vars in 1282 bytes} [Tue May 17 17:14:29 2022] POST /compute/v2.1/flavors => generated 402 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 17:14:29.998671 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-c1f993d8-cf6d-42a9-8792-2393a6fcbc93 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:30.095446 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-c1f993d8-cf6d-42a9-8792-2393a6fcbc93 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100258 May 17 17:14:30.096099 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 11/23] 10.222.0.88 () {64 vars in 1332 bytes} [Tue May 17 17:14:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:14:32.678705 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-5a3a8e80-9996-41d1-9c54-6aee9e3352d4 admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:32.684061 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-5a3a8e80-9996-41d1-9c54-6aee9e3352d4 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 May 17 17:14:32.684061 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 13/24] 10.222.0.88 () {54 vars in 930 bytes} [Tue May 17 17:14:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:14:32.746581 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-72f6c98c-4626-4434-9d47-46eab3981470 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "disk": 20, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "2", "ram": 2048}} {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:32.883347 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-72f6c98c-4626-4434-9d47-46eab3981470 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.197370 May 17 17:14:32.884180 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 12/25] 10.222.0.88 () {64 vars in 1282 bytes} [Tue May 17 17:14:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 17:14:32.897637 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-890b8eef-6fab-4781-85a3-c9047f3c89e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:32.983413 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-890b8eef-6fab-4781-85a3-c9047f3c89e1 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089577 May 17 17:14:32.984107 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 14/26] 10.222.0.88 () {64 vars in 1332 bytes} [Tue May 17 17:14:32 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:35.316661 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-72f6c98c-4626-4434-9d47-46eab3981470 admin admin] Calling method '>' {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:35.317661 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-72f6c98c-4626-4434-9d47-46eab3981470 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 May 17 17:14:35.318064 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 13/27] 10.222.0.88 () {54 vars in 930 bytes} [Tue May 17 17:14:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:14:35.374165 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-e3febeb5-ad39-4bcc-a39d-9b571137b7e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "vcpus": 2, "disk": 40, "swap": 0, "id": "3", "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:35.474375 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-e3febeb5-ad39-4bcc-a39d-9b571137b7e5 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.150617 May 17 17:14:35.475120 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 15/28] 10.222.0.88 () {64 vars in 1282 bytes} [Tue May 17 17:14:35 2022] POST /compute/v2.1/flavors => generated 406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 17:14:35.487444 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-309adb1e-0b9b-445d-8900-7b55c4788aa0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:35.557774 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-309adb1e-0b9b-445d-8900-7b55c4788aa0 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074128 May 17 17:14:35.558342 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 14/29] 10.222.0.88 () {64 vars in 1332 bytes} [Tue May 17 17:14:35 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:37.835854 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-e3febeb5-ad39-4bcc-a39d-9b571137b7e5 admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:37.836882 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-e3febeb5-ad39-4bcc-a39d-9b571137b7e5 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 May 17 17:14:37.837302 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 16/30] 10.222.0.88 () {54 vars in 930 bytes} [Tue May 17 17:14:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:14:37.895226 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-ac617515-6cdc-4a9e-825d-e043e2974a9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "vcpus": 4, "swap": 0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 80}} {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:37.989573 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-ac617515-6cdc-4a9e-825d-e043e2974a9a admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.146459 May 17 17:14:37.990118 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 15/31] 10.222.0.88 () {64 vars in 1282 bytes} [Tue May 17 17:14:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 17:14:38.002541 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-421703b8-85ad-4885-aaa9-384c7a5bee72 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:38.096615 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-421703b8-85ad-4885-aaa9-384c7a5bee72 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097655 May 17 17:14:38.097200 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 17/32] 10.222.0.88 () {64 vars in 1332 bytes} [Tue May 17 17:14:37 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:14:40.403683 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-ac617515-6cdc-4a9e-825d-e043e2974a9a admin admin] Calling method '>' {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:14:40.405358 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-ac617515-6cdc-4a9e-825d-e043e2974a9a admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002148 May 17 17:14:40.405810 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 16/33] 10.222.0.88 () {54 vars in 930 bytes} [Tue May 17 17:14:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:14:40.465804 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-f0ef2f0d-bbe6-4835-9bbc-f91cb167439d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "ram": 16384, "name": "m1.xlarge", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160}} {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:40.654876 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-f0ef2f0d-bbe6-4835-9bbc-f91cb167439d admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.242700 May 17 17:14:40.655489 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 18/34] 10.222.0.88 () {64 vars in 1282 bytes} [Tue May 17 17:14:40 2022] POST /compute/v2.1/flavors => generated 408 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 17:14:40.668259 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-d7847ae3-5785-4ecc-8e91-02f5d0bd69f4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:14:40.746880 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-d7847ae3-5785-4ecc-8e91-02f5d0bd69f4 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083028 May 17 17:14:40.756821 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 17/35] 10.222.0.88 () {64 vars in 1332 bytes} [Tue May 17 17:14:40 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:15:04.948496 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-f0ef2f0d-bbe6-4835-9bbc-f91cb167439d admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:04.949535 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-f0ef2f0d-bbe6-4835-9bbc-f91cb167439d admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 May 17 17:15:04.949932 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 19/36] 10.222.0.88 () {54 vars in 930 bytes} [Tue May 17 17:15:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:05.006517 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-fc192184-facb-489a-81d0-e69a5486d371 admin admin] Calling method '>' {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:05.023017 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-fc192184-facb-489a-81d0-e69a5486d371 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067123 May 17 17:15:05.024065 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 18/37] 10.222.0.88 () {60 vars in 1291 bytes} [Tue May 17 17:15:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:15:06.025569 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-f0ef2f0d-bbe6-4835-9bbc-f91cb167439d admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:06.026567 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-f0ef2f0d-bbe6-4835-9bbc-f91cb167439d admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 17 17:15:06.026964 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 20/38] 10.222.0.88 () {56 vars in 1074 bytes} [Tue May 17 17:15:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:06.233140 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-1de6a8a1-9fdb-40d9-8ad2-79b537a6087b admin admin] Calling method '>' {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:06.238741 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.wsgi [None req-1de6a8a1-9fdb-40d9-8ad2-79b537a6087b admin admin] HTTP exception thrown: Flavor 42 could not be found. May 17 17:15:06.241868 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-1de6a8a1-9fdb-40d9-8ad2-79b537a6087b admin admin] Request method failure captured: May 17 17:15:06.241868 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 17 17:15:06.241868 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: Accept: application/json May 17 17:15:06.241868 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: Accept-Encoding: gzip, deflate May 17 17:15:06.241868 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: Connection: keep-alive May 17 17:15:06.241868 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: Content-Length: 0 May 17 17:15:06.241868 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: Host: 10.222.0.88 May 17 17:15:06.241868 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: Openstack-Api-Version: compute 2.90 May 17 17:15:06.241868 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: Openstack-System-Scope: None May 17 17:15:06.241868 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: User-Agent: python-novaclient May 17 17:15:06.241868 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Auth-Token: gAAAAABig9gaD87HdAx_ybyHafuDCKraMA1_W0-iA-Tqhi24Ohb0Qgjq90CbvMr0j0Lqy6RkxAly1ZAsOZXyyzfduYQgQITcWWrwVlMcPQigIh_gQ92Mj9iIGckJfeYOEiRT13Z0kRUfFsR4ZRcDYPwklP7TG8QRVUFPIX8UmxSv7Ospi-Vu3kI May 17 17:15:06.241868 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Domain-Id: None May 17 17:15:06.241868 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Domain-Name: None May 17 17:15:06.241868 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Identity-Status: Confirmed May 17 17:15:06.241868 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Is-Admin-Project: True May 17 17:15:06.241868 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Openstack-Nova-Api-Version: 2.90 May 17 17:15:06.241868 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Project-Domain-Id: default May 17 17:15:06.241868 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Project-Domain-Name: Default May 17 17:15:06.241868 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Project-Id: bd6fddbd260a43959602c131b925e1e9 May 17 17:15:06.241868 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Project-Name: admin May 17 17:15:06.241868 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Role: reader,member,admin May 17 17:15:06.241868 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Roles: reader,member,admin May 17 17:15:06.244263 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bd6fddbd260a43959602c131b925e1e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/bd6fddbd260a43959602c131b925e1e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bd6fddbd260a43959602c131b925e1e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_bd6fddbd260a43959602c131b925e1e9", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:15:06.244263 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Tenant: admin May 17 17:15:06.244263 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Tenant-Id: bd6fddbd260a43959602c131b925e1e9 May 17 17:15:06.244263 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Tenant-Name: admin May 17 17:15:06.244263 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-User: admin May 17 17:15:06.244263 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-User-Domain-Id: default May 17 17:15:06.244263 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-User-Domain-Name: Default May 17 17:15:06.244263 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-User-Id: dc79c5ce823042028d8ed3f808987f0b May 17 17:15:06.244263 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-User-Name: admin May 17 17:15:06.244263 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: method: > May 17 17:15:06.244263 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: exception: Flavor 42 could not be found. May 17 17:15:06.244263 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: action_args: {'id': '42'} May 17 17:15:06.244263 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:15:06.244263 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:06.245318 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 17:15:06.245318 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 17:15:06.245318 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 17:15:06.245318 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 17:15:06.245318 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 17:15:06.245318 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 17:15:06.245318 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 17:15:06.245318 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 17:15:06.245318 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 17:15:06.245318 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:15:06.245318 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 17:15:06.245318 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 17:15:06.245318 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 17 17:15:06.245318 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi May 17 17:15:06.245318 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:15:06.245318 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi May 17 17:15:06.245318 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:06.245318 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:15:06.245318 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:15:06.246804 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:15:06.246804 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:15:06.246804 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:15:06.246804 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:15:06.246804 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 17:15:06.246804 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 17:15:06.246804 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 17 17:15:06.246804 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi May 17 17:15:06.246804 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:15:06.246804 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi May 17 17:15:06.246804 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:06.246804 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:15:06.246804 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:15:06.246804 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:15:06.246804 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:15:06.246804 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 17 17:15:06.246804 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi May 17 17:15:06.246804 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-1de6a8a1-9fdb-40d9-8ad2-79b537a6087b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:15:06.248231 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-1de6a8a1-9fdb-40d9-8ad2-79b537a6087b admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060274 May 17 17:15:06.248231 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 19/39] 10.222.0.88 () {60 vars in 1190 bytes} [Tue May 17 17:15:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 17:15:06.253697 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-86af9afd-4f1f-49cf-b9f7-f910e30ac7ab admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:06.274788 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-86af9afd-4f1f-49cf-b9f7-f910e30ac7ab admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024621 May 17 17:15:06.275455 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 21/40] 10.222.0.88 () {60 vars in 1210 bytes} [Tue May 17 17:15:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:15:06.284858 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-2e92eac0-0fe0-4475-9b5e-bce26aaf53d0 admin admin] Calling method '>' {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:06.306741 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-2e92eac0-0fe0-4475-9b5e-bce26aaf53d0 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025637 May 17 17:15:06.307257 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 20/41] 10.222.0.88 () {60 vars in 1210 bytes} [Tue May 17 17:15:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:15:06.316045 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-a3382cca-5073-487c-a81c-515dcaa53d6b admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:06.321421 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.wsgi [None req-a3382cca-5073-487c-a81c-515dcaa53d6b admin admin] HTTP exception thrown: Flavor 42 could not be found. May 17 17:15:06.324649 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-a3382cca-5073-487c-a81c-515dcaa53d6b admin admin] Request method failure captured: May 17 17:15:06.324649 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 17 17:15:06.324649 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: Accept: application/json May 17 17:15:06.324649 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: Accept-Encoding: gzip, deflate May 17 17:15:06.324649 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: Connection: keep-alive May 17 17:15:06.324649 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: Content-Length: 0 May 17 17:15:06.324649 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: Host: 10.222.0.88 May 17 17:15:06.324649 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: Openstack-Api-Version: compute 2.90 May 17 17:15:06.324649 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: Openstack-System-Scope: None May 17 17:15:06.324649 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: User-Agent: python-novaclient May 17 17:15:06.324649 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Auth-Token: gAAAAABig9gaD87HdAx_ybyHafuDCKraMA1_W0-iA-Tqhi24Ohb0Qgjq90CbvMr0j0Lqy6RkxAly1ZAsOZXyyzfduYQgQITcWWrwVlMcPQigIh_gQ92Mj9iIGckJfeYOEiRT13Z0kRUfFsR4ZRcDYPwklP7TG8QRVUFPIX8UmxSv7Ospi-Vu3kI May 17 17:15:06.324649 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Domain-Id: None May 17 17:15:06.324649 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Domain-Name: None May 17 17:15:06.324649 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Identity-Status: Confirmed May 17 17:15:06.324649 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Is-Admin-Project: True May 17 17:15:06.324649 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Openstack-Nova-Api-Version: 2.90 May 17 17:15:06.324649 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Project-Domain-Id: default May 17 17:15:06.324649 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Project-Domain-Name: Default May 17 17:15:06.324649 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Project-Id: bd6fddbd260a43959602c131b925e1e9 May 17 17:15:06.324649 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Project-Name: admin May 17 17:15:06.324649 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Role: reader,member,admin May 17 17:15:06.324649 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Roles: reader,member,admin May 17 17:15:06.326186 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bd6fddbd260a43959602c131b925e1e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/bd6fddbd260a43959602c131b925e1e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bd6fddbd260a43959602c131b925e1e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_bd6fddbd260a43959602c131b925e1e9", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:15:06.326186 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Tenant: admin May 17 17:15:06.326186 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Tenant-Id: bd6fddbd260a43959602c131b925e1e9 May 17 17:15:06.326186 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Tenant-Name: admin May 17 17:15:06.326186 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-User: admin May 17 17:15:06.326186 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-User-Domain-Id: default May 17 17:15:06.326186 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-User-Domain-Name: Default May 17 17:15:06.326186 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-User-Id: dc79c5ce823042028d8ed3f808987f0b May 17 17:15:06.326186 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-User-Name: admin May 17 17:15:06.326186 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: method: > May 17 17:15:06.326186 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: exception: Flavor 42 could not be found. May 17 17:15:06.326186 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: action_args: {'id': '42'} May 17 17:15:06.326186 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:15:06.326186 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:06.327052 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 17:15:06.327052 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 17:15:06.327052 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 17:15:06.327052 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 17:15:06.327052 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 17:15:06.327052 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 17:15:06.327052 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 17:15:06.327052 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 17:15:06.327052 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 17:15:06.327052 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:15:06.327052 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 17:15:06.327052 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 17:15:06.327052 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 17 17:15:06.327052 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 17 17:15:06.327052 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:15:06.327052 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 17 17:15:06.327052 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:06.327052 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:15:06.327052 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:15:06.328297 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:15:06.328297 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:15:06.328297 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:15:06.328297 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:15:06.328297 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 17:15:06.328297 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 17:15:06.328297 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 17 17:15:06.328297 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 17 17:15:06.328297 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:15:06.328297 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 17 17:15:06.328297 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:06.328297 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:15:06.328297 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:15:06.328297 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:15:06.328297 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:15:06.328297 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 17 17:15:06.328297 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 17 17:15:06.328297 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-a3382cca-5073-487c-a81c-515dcaa53d6b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:15:06.329532 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-a3382cca-5073-487c-a81c-515dcaa53d6b admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013422 May 17 17:15:06.329532 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 22/42] 10.222.0.88 () {60 vars in 1190 bytes} [Tue May 17 17:15:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 17 17:15:07.200726 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-2e92eac0-0fe0-4475-9b5e-bce26aaf53d0 admin admin] Calling method '>' {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:07.201726 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-2e92eac0-0fe0-4475-9b5e-bce26aaf53d0 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 May 17 17:15:07.203052 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 21/43] 10.222.0.88 () {56 vars in 1074 bytes} [Tue May 17 17:15:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:07.387819 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-78802428-29d0-49ba-bd28-9d54343456dc admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:07.393099 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.wsgi [None req-78802428-29d0-49ba-bd28-9d54343456dc admin admin] HTTP exception thrown: Flavor 84 could not be found. May 17 17:15:07.394582 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-78802428-29d0-49ba-bd28-9d54343456dc admin admin] Request method failure captured: May 17 17:15:07.394582 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 17 17:15:07.394582 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: Accept: application/json May 17 17:15:07.394582 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: Accept-Encoding: gzip, deflate May 17 17:15:07.394582 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: Connection: keep-alive May 17 17:15:07.394582 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: Content-Length: 0 May 17 17:15:07.394582 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: Host: 10.222.0.88 May 17 17:15:07.394582 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: Openstack-Api-Version: compute 2.90 May 17 17:15:07.394582 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: Openstack-System-Scope: None May 17 17:15:07.394582 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: User-Agent: python-novaclient May 17 17:15:07.394582 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Auth-Token: gAAAAABig9gbXl4BGvtOayaOhMRa5wRHJ5LFbP4lFM38S1LYx9AOtyaCyo72iERNu9l2dpR-PMRVw27Y_HqivRq9qphsSTIhdUaTKTb3ZNDifYck5XthJri4JTE7oRlnBaEbB5X5xzbkePgXXq5p9_1OsfFOyN01VM5NcqZ_l9tE7sm2hW3lweU May 17 17:15:07.394582 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Domain-Id: None May 17 17:15:07.394582 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Domain-Name: None May 17 17:15:07.394582 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Identity-Status: Confirmed May 17 17:15:07.394582 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Is-Admin-Project: True May 17 17:15:07.394582 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Openstack-Nova-Api-Version: 2.90 May 17 17:15:07.394582 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Project-Domain-Id: default May 17 17:15:07.394582 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Project-Domain-Name: Default May 17 17:15:07.394582 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Project-Id: bd6fddbd260a43959602c131b925e1e9 May 17 17:15:07.394582 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Project-Name: admin May 17 17:15:07.394582 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Role: reader,member,admin May 17 17:15:07.394582 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Roles: reader,member,admin May 17 17:15:07.396132 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bd6fddbd260a43959602c131b925e1e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/bd6fddbd260a43959602c131b925e1e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bd6fddbd260a43959602c131b925e1e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_bd6fddbd260a43959602c131b925e1e9", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:15:07.396132 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Tenant: admin May 17 17:15:07.396132 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Tenant-Id: bd6fddbd260a43959602c131b925e1e9 May 17 17:15:07.396132 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Tenant-Name: admin May 17 17:15:07.396132 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-User: admin May 17 17:15:07.396132 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-User-Domain-Id: default May 17 17:15:07.396132 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-User-Domain-Name: Default May 17 17:15:07.396132 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-User-Id: dc79c5ce823042028d8ed3f808987f0b May 17 17:15:07.396132 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-User-Name: admin May 17 17:15:07.396132 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: method: > May 17 17:15:07.396132 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: exception: Flavor 84 could not be found. May 17 17:15:07.396132 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: action_args: {'id': '84'} May 17 17:15:07.396132 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:15:07.396132 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:07.397127 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 17:15:07.397127 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 17:15:07.397127 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 17:15:07.397127 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 17:15:07.397127 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 17:15:07.397127 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 17:15:07.397127 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 17:15:07.397127 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 17:15:07.397127 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 17:15:07.397127 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:15:07.397127 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 17:15:07.397127 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 17:15:07.397127 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 17 17:15:07.397127 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 17 17:15:07.397127 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:15:07.397127 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 17 17:15:07.397127 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:07.397127 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:15:07.397127 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:15:07.398586 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:15:07.398586 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:15:07.398586 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:15:07.398586 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:15:07.398586 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 17:15:07.398586 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 17:15:07.398586 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 17 17:15:07.398586 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 17 17:15:07.398586 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:15:07.398586 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 17 17:15:07.398586 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:07.398586 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:15:07.398586 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:15:07.398586 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:15:07.398586 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:15:07.398586 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 17 17:15:07.398586 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 17 17:15:07.398586 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-78802428-29d0-49ba-bd28-9d54343456dc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:15:07.399905 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-78802428-29d0-49ba-bd28-9d54343456dc admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059039 May 17 17:15:07.399905 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 23/44] 10.222.0.88 () {60 vars in 1190 bytes} [Tue May 17 17:15:07 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 17:15:07.406129 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-68031a7f-c593-4515-a0a6-125048914d8d admin admin] Calling method '>' {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:07.419952 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-68031a7f-c593-4515-a0a6-125048914d8d admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017934 May 17 17:15:07.420474 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 22/45] 10.222.0.88 () {60 vars in 1210 bytes} [Tue May 17 17:15:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:15:07.430175 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-46088201-9d44-4406-8016-3dd4f92301ac admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:07.443553 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-46088201-9d44-4406-8016-3dd4f92301ac admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017375 May 17 17:15:07.444107 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 24/46] 10.222.0.88 () {60 vars in 1210 bytes} [Tue May 17 17:15:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:15:07.453764 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-fee1c47a-053e-468c-967b-4363ef24ca53 admin admin] Calling method '>' {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:07.458955 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.wsgi [None req-fee1c47a-053e-468c-967b-4363ef24ca53 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 17 17:15:07.460462 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-fee1c47a-053e-468c-967b-4363ef24ca53 admin admin] Request method failure captured: May 17 17:15:07.460462 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 17 17:15:07.460462 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: Accept: application/json May 17 17:15:07.460462 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: Accept-Encoding: gzip, deflate May 17 17:15:07.460462 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: Connection: keep-alive May 17 17:15:07.460462 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: Content-Length: 0 May 17 17:15:07.460462 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: Host: 10.222.0.88 May 17 17:15:07.460462 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: Openstack-Api-Version: compute 2.90 May 17 17:15:07.460462 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: Openstack-System-Scope: None May 17 17:15:07.460462 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: User-Agent: python-novaclient May 17 17:15:07.460462 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Auth-Token: gAAAAABig9gbXl4BGvtOayaOhMRa5wRHJ5LFbP4lFM38S1LYx9AOtyaCyo72iERNu9l2dpR-PMRVw27Y_HqivRq9qphsSTIhdUaTKTb3ZNDifYck5XthJri4JTE7oRlnBaEbB5X5xzbkePgXXq5p9_1OsfFOyN01VM5NcqZ_l9tE7sm2hW3lweU May 17 17:15:07.460462 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Domain-Id: None May 17 17:15:07.460462 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Domain-Name: None May 17 17:15:07.460462 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Identity-Status: Confirmed May 17 17:15:07.460462 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Is-Admin-Project: True May 17 17:15:07.460462 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Openstack-Nova-Api-Version: 2.90 May 17 17:15:07.460462 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Project-Domain-Id: default May 17 17:15:07.460462 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Project-Domain-Name: Default May 17 17:15:07.460462 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Project-Id: bd6fddbd260a43959602c131b925e1e9 May 17 17:15:07.460462 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Project-Name: admin May 17 17:15:07.460462 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Role: reader,member,admin May 17 17:15:07.460462 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Roles: reader,member,admin May 17 17:15:07.462056 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bd6fddbd260a43959602c131b925e1e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/bd6fddbd260a43959602c131b925e1e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bd6fddbd260a43959602c131b925e1e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_bd6fddbd260a43959602c131b925e1e9", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:15:07.462056 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Tenant: admin May 17 17:15:07.462056 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Tenant-Id: bd6fddbd260a43959602c131b925e1e9 May 17 17:15:07.462056 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Tenant-Name: admin May 17 17:15:07.462056 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-User: admin May 17 17:15:07.462056 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-User-Domain-Id: default May 17 17:15:07.462056 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-User-Domain-Name: Default May 17 17:15:07.462056 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-User-Id: dc79c5ce823042028d8ed3f808987f0b May 17 17:15:07.462056 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-User-Name: admin May 17 17:15:07.462056 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: method: > May 17 17:15:07.462056 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: exception: Flavor 84 could not be found. May 17 17:15:07.462056 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: action_args: {'id': '84'} May 17 17:15:07.462056 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:15:07.462056 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:07.463254 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 17:15:07.463254 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 17:15:07.463254 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 17:15:07.463254 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 17:15:07.463254 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 17:15:07.463254 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 17:15:07.463254 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 17:15:07.463254 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 17:15:07.463254 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 17:15:07.463254 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:15:07.463254 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 17:15:07.463254 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 17:15:07.463254 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 17 17:15:07.463254 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi May 17 17:15:07.463254 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:15:07.463254 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi May 17 17:15:07.463254 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:07.463254 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:15:07.463254 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:15:07.464681 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:15:07.464681 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:15:07.464681 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:15:07.464681 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:15:07.464681 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 17:15:07.464681 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 17:15:07.464681 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 17 17:15:07.464681 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi May 17 17:15:07.464681 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:15:07.464681 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi May 17 17:15:07.464681 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:07.464681 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:15:07.464681 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:15:07.464681 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:15:07.464681 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:15:07.464681 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 17 17:15:07.464681 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi May 17 17:15:07.464681 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-fee1c47a-053e-468c-967b-4363ef24ca53 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:15:07.465934 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-fee1c47a-053e-468c-967b-4363ef24ca53 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011516 May 17 17:15:07.465934 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 23/47] 10.222.0.88 () {60 vars in 1190 bytes} [Tue May 17 17:15:07 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 17:15:08.338020 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-46088201-9d44-4406-8016-3dd4f92301ac admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:08.339017 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-46088201-9d44-4406-8016-3dd4f92301ac admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 May 17 17:15:08.339411 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 25/48] 10.222.0.88 () {56 vars in 1074 bytes} [Tue May 17 17:15:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:08.524560 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-654f8abd-a779-4d70-9b7d-fa247c693296 admin admin] Calling method '>' {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:08.530545 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.wsgi [None req-654f8abd-a779-4d70-9b7d-fa247c693296 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 17 17:15:08.532052 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-654f8abd-a779-4d70-9b7d-fa247c693296 admin admin] Request method failure captured: May 17 17:15:08.532052 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 17 17:15:08.532052 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: Accept: application/json May 17 17:15:08.532052 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: Accept-Encoding: gzip, deflate May 17 17:15:08.532052 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: Connection: keep-alive May 17 17:15:08.532052 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: Content-Length: 0 May 17 17:15:08.532052 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: Host: 10.222.0.88 May 17 17:15:08.532052 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: Openstack-Api-Version: compute 2.90 May 17 17:15:08.532052 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: Openstack-System-Scope: None May 17 17:15:08.532052 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: User-Agent: python-novaclient May 17 17:15:08.532052 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Auth-Token: gAAAAABig9gcdjs6cHiDzzyv4H-JCChIF08QL_zc491n781FX2_dibs7AsUrqeb2RfyaG3Zh29qXqLMG7JLc5jnaPA6rpZKW7yk3wpwcu0CW062oPK9oX2SQv_tjatyBtguWJT0R_PWrocvoa7Iz9-mDjFLKogB1T97cRSfwPAzeRv2b1v-TQ20 May 17 17:15:08.532052 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Domain-Id: None May 17 17:15:08.532052 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Domain-Name: None May 17 17:15:08.532052 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Identity-Status: Confirmed May 17 17:15:08.532052 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Is-Admin-Project: True May 17 17:15:08.532052 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Openstack-Nova-Api-Version: 2.90 May 17 17:15:08.532052 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Project-Domain-Id: default May 17 17:15:08.532052 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Project-Domain-Name: Default May 17 17:15:08.532052 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Project-Id: bd6fddbd260a43959602c131b925e1e9 May 17 17:15:08.532052 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Project-Name: admin May 17 17:15:08.532052 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Role: reader,member,admin May 17 17:15:08.532052 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Roles: reader,member,admin May 17 17:15:08.533861 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bd6fddbd260a43959602c131b925e1e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/bd6fddbd260a43959602c131b925e1e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bd6fddbd260a43959602c131b925e1e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_bd6fddbd260a43959602c131b925e1e9", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:15:08.533861 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Tenant: admin May 17 17:15:08.533861 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Tenant-Id: bd6fddbd260a43959602c131b925e1e9 May 17 17:15:08.533861 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-Tenant-Name: admin May 17 17:15:08.533861 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-User: admin May 17 17:15:08.533861 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-User-Domain-Id: default May 17 17:15:08.533861 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-User-Domain-Name: Default May 17 17:15:08.533861 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-User-Id: dc79c5ce823042028d8ed3f808987f0b May 17 17:15:08.533861 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: X-User-Name: admin May 17 17:15:08.533861 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: method: > May 17 17:15:08.533861 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: exception: Flavor 451 could not be found. May 17 17:15:08.533861 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: action_args: {'id': '451'} May 17 17:15:08.533861 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:15:08.533861 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:08.534811 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 17:15:08.534811 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 17:15:08.534811 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 17:15:08.534811 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 17:15:08.534811 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 17:15:08.534811 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 17:15:08.534811 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 17:15:08.534811 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 17:15:08.534811 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 17:15:08.534811 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:15:08.534811 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 17:15:08.534811 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 17:15:08.534811 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 17 17:15:08.534811 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi May 17 17:15:08.534811 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:15:08.534811 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi May 17 17:15:08.534811 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:08.534811 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:15:08.534811 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:15:08.536167 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:15:08.536167 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:15:08.536167 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:15:08.536167 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:15:08.536167 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 17:15:08.536167 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 17:15:08.536167 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 17 17:15:08.536167 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi May 17 17:15:08.536167 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:15:08.536167 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi May 17 17:15:08.536167 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:08.536167 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:15:08.536167 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:15:08.536167 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:15:08.536167 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:15:08.536167 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 17 17:15:08.536167 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: ERROR nova.api.openstack.wsgi May 17 17:15:08.536167 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-654f8abd-a779-4d70-9b7d-fa247c693296 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:15:08.537423 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-654f8abd-a779-4d70-9b7d-fa247c693296 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059442 May 17 17:15:08.537423 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 24/49] 10.222.0.88 () {60 vars in 1193 bytes} [Tue May 17 17:15:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 17:15:08.543335 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-a3d13f76-76ac-484b-8e1c-27e67169d107 admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:08.556702 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-a3d13f76-76ac-484b-8e1c-27e67169d107 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016844 May 17 17:15:08.557157 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 26/50] 10.222.0.88 () {60 vars in 1210 bytes} [Tue May 17 17:15:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:15:08.566133 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-8eff5695-90a9-4477-9511-2492444b33df admin admin] Calling method '>' {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:08.580044 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-8eff5695-90a9-4477-9511-2492444b33df admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017216 May 17 17:15:08.580571 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 25/51] 10.222.0.88 () {60 vars in 1210 bytes} [Tue May 17 17:15:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:15:08.590444 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-b1300f53-1535-4d45-b47a-415e8e98f846 admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:08.595612 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.wsgi [None req-b1300f53-1535-4d45-b47a-415e8e98f846 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 17 17:15:08.597115 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-b1300f53-1535-4d45-b47a-415e8e98f846 admin admin] Request method failure captured: May 17 17:15:08.597115 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 17 17:15:08.597115 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: Accept: application/json May 17 17:15:08.597115 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: Accept-Encoding: gzip, deflate May 17 17:15:08.597115 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: Connection: keep-alive May 17 17:15:08.597115 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: Content-Length: 0 May 17 17:15:08.597115 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: Host: 10.222.0.88 May 17 17:15:08.597115 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: Openstack-Api-Version: compute 2.90 May 17 17:15:08.597115 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: Openstack-System-Scope: None May 17 17:15:08.597115 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: User-Agent: python-novaclient May 17 17:15:08.597115 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Auth-Token: gAAAAABig9gcdjs6cHiDzzyv4H-JCChIF08QL_zc491n781FX2_dibs7AsUrqeb2RfyaG3Zh29qXqLMG7JLc5jnaPA6rpZKW7yk3wpwcu0CW062oPK9oX2SQv_tjatyBtguWJT0R_PWrocvoa7Iz9-mDjFLKogB1T97cRSfwPAzeRv2b1v-TQ20 May 17 17:15:08.597115 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Domain-Id: None May 17 17:15:08.597115 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Domain-Name: None May 17 17:15:08.597115 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Identity-Status: Confirmed May 17 17:15:08.597115 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Is-Admin-Project: True May 17 17:15:08.597115 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Openstack-Nova-Api-Version: 2.90 May 17 17:15:08.597115 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Project-Domain-Id: default May 17 17:15:08.597115 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Project-Domain-Name: Default May 17 17:15:08.597115 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Project-Id: bd6fddbd260a43959602c131b925e1e9 May 17 17:15:08.597115 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Project-Name: admin May 17 17:15:08.597115 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Role: reader,member,admin May 17 17:15:08.597115 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Roles: reader,member,admin May 17 17:15:08.598600 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bd6fddbd260a43959602c131b925e1e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/bd6fddbd260a43959602c131b925e1e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bd6fddbd260a43959602c131b925e1e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_bd6fddbd260a43959602c131b925e1e9", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:15:08.598600 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Tenant: admin May 17 17:15:08.598600 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Tenant-Id: bd6fddbd260a43959602c131b925e1e9 May 17 17:15:08.598600 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-Tenant-Name: admin May 17 17:15:08.598600 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-User: admin May 17 17:15:08.598600 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-User-Domain-Id: default May 17 17:15:08.598600 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-User-Domain-Name: Default May 17 17:15:08.598600 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-User-Id: dc79c5ce823042028d8ed3f808987f0b May 17 17:15:08.598600 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: X-User-Name: admin May 17 17:15:08.598600 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: method: > May 17 17:15:08.598600 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: exception: Flavor 451 could not be found. May 17 17:15:08.598600 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: action_args: {'id': '451'} May 17 17:15:08.598600 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:15:08.598600 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:08.599404 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 17:15:08.599404 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 17:15:08.599404 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 17:15:08.599404 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 17:15:08.599404 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 17:15:08.599404 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 17:15:08.599404 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 17:15:08.599404 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 17:15:08.599404 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 17:15:08.599404 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:15:08.599404 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 17:15:08.599404 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 17:15:08.599404 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 17 17:15:08.599404 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 17 17:15:08.599404 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:15:08.599404 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 17 17:15:08.599404 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:08.599404 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:15:08.599404 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:15:08.605070 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:15:08.605070 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:15:08.605070 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:15:08.605070 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:15:08.605070 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 17:15:08.605070 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 17:15:08.605070 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 17 17:15:08.605070 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 17 17:15:08.605070 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:15:08.605070 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 17 17:15:08.605070 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:15:08.605070 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:15:08.605070 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:15:08.605070 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:15:08.605070 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:15:08.605070 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 17 17:15:08.605070 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: ERROR nova.api.openstack.wsgi May 17 17:15:08.605070 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-b1300f53-1535-4d45-b47a-415e8e98f846 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:15:08.606165 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-b1300f53-1535-4d45-b47a-415e8e98f846 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011546 May 17 17:15:08.606165 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 27/52] 10.222.0.88 () {60 vars in 1193 bytes} [Tue May 17 17:15:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 17:15:09.470687 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-8eff5695-90a9-4477-9511-2492444b33df admin admin] Calling method '>' {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:09.471756 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-8eff5695-90a9-4477-9511-2492444b33df admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 May 17 17:15:09.472147 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 26/53] 10.222.0.88 () {56 vars in 1074 bytes} [Tue May 17 17:15:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:09.659246 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-437f6b59-4cc0-47f5-ba6f-69747615c841 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:15:09.795637 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-437f6b59-4cc0-47f5-ba6f-69747615c841 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.186940 May 17 17:15:09.796140 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 28/54] 10.222.0.88 () {64 vars in 1235 bytes} [Tue May 17 17:15:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 17:15:10.685866 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-8eff5695-90a9-4477-9511-2492444b33df admin admin] Calling method '>' {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:10.686860 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-8eff5695-90a9-4477-9511-2492444b33df admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 May 17 17:15:10.687282 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 27/55] 10.222.0.88 () {56 vars in 1074 bytes} [Tue May 17 17:15:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:10.872855 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-216ad871-25a5-45db-8aeb-01a1aa801ea7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:15:10.937324 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-216ad871-25a5-45db-8aeb-01a1aa801ea7 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.114464 May 17 17:15:10.941181 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 29/56] 10.222.0.88 () {64 vars in 1235 bytes} [Tue May 17 17:15:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 17:15:11.815901 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-8eff5695-90a9-4477-9511-2492444b33df admin admin] Calling method '>' {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:11.816886 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-8eff5695-90a9-4477-9511-2492444b33df admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 May 17 17:15:11.817274 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 28/57] 10.222.0.88 () {56 vars in 1074 bytes} [Tue May 17 17:15:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:12.005276 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-87de9194-a34b-4061-8584-8feae17d1d5c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:15:12.096736 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-87de9194-a34b-4061-8584-8feae17d1d5c admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.142398 May 17 17:15:12.097277 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 30/58] 10.222.0.88 () {64 vars in 1235 bytes} [Tue May 17 17:15:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 17:15:12.981372 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-8eff5695-90a9-4477-9511-2492444b33df admin admin] Calling method '>' {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:12.982358 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-8eff5695-90a9-4477-9511-2492444b33df admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001388 May 17 17:15:12.982751 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 29/59] 10.222.0.88 () {56 vars in 1074 bytes} [Tue May 17 17:15:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:13.167552 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-806c5271-60b9-4bf3-a6e9-8e82211e9ca2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:15:13.290735 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-806c5271-60b9-4bf3-a6e9-8e82211e9ca2 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.172659 May 17 17:15:13.291272 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 31/60] 10.222.0.88 () {64 vars in 1235 bytes} [Tue May 17 17:15:13 2022] POST /compute/v2.1/flavors => generated 409 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 17:15:14.170947 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-8eff5695-90a9-4477-9511-2492444b33df admin admin] Calling method '>' {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:14.171973 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-8eff5695-90a9-4477-9511-2492444b33df admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 May 17 17:15:14.172368 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 30/61] 10.222.0.88 () {56 vars in 1074 bytes} [Tue May 17 17:15:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:15:14.355992 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-5cc06c99-a157-411b-bed1-ca0759adb515 admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:15:14.375099 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-5cc06c99-a157-411b-bed1-ca0759adb515 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.068886 May 17 17:15:14.375662 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 32/62] 10.222.0.88 () {60 vars in 1202 bytes} [Tue May 17 17:15:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:15.924128 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-8eff5695-90a9-4477-9511-2492444b33df admin admin] Calling method '>' {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:15.925121 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-8eff5695-90a9-4477-9511-2492444b33df admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 May 17 17:16:15.925511 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 31/63] 10.222.0.88 () {54 vars in 930 bytes} [Tue May 17 17:16:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:16:15.983235 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-21bb6960-1970-45fb-9d46-71d5b70243b1 admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:16.001888 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-21bb6960-1970-45fb-9d46-71d5b70243b1 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070774 May 17 17:16:16.002413 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 33/64] 10.222.0.88 () {60 vars in 1291 bytes} [Tue May 17 17:16:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:16:16.024781 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-4a675c6e-a8aa-457d-addf-3fa297f74744 admin admin] Calling method '>' {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:16.032495 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-4a675c6e-a8aa-457d-addf-3fa297f74744 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012489 May 17 17:16:16.033010 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 32/65] 10.222.0.88 () {60 vars in 1282 bytes} [Tue May 17 17:16:16 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:16.044343 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-c2cbdac6-047f-4098-8b3a-f0577e8de00f admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:16.051620 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-c2cbdac6-047f-4098-8b3a-f0577e8de00f admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010736 May 17 17:16:16.052128 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 34/66] 10.222.0.88 () {60 vars in 1285 bytes} [Tue May 17 17:16:16 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:16.062669 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-fa6f70a8-ff8b-415c-a5e2-259a5e93a263 admin admin] Calling method '>' {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:16.069866 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-fa6f70a8-ff8b-415c-a5e2-259a5e93a263 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010714 May 17 17:16:16.070368 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 33/67] 10.222.0.88 () {60 vars in 1285 bytes} [Tue May 17 17:16:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:16:16.080990 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-6be0a922-b383-4841-a7d8-72954ea58b1c admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:16:16.088674 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-6be0a922-b383-4841-a7d8-72954ea58b1c admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011026 May 17 17:16:16.089180 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 35/68] 10.222.0.88 () {60 vars in 1282 bytes} [Tue May 17 17:16:16 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:19:51.621942 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-fa6f70a8-ff8b-415c-a5e2-259a5e93a263 admin admin] Calling method '>' {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:51.622970 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-fa6f70a8-ff8b-415c-a5e2-259a5e93a263 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 May 17 17:19:51.623725 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 34/69] 10.222.0.88 () {56 vars in 1074 bytes} [Tue May 17 17:19:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:19:51.888681 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-ee17dbd2-67c2-467b-a1ac-adf133c76d32 admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:51.889827 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 17:19:51.889827 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: warnings.warn(msg) May 17 17:19:51.890998 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-ee17dbd2-67c2-467b-a1ac-adf133c76d32 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:51.891425 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-ee17dbd2-67c2-467b-a1ac-adf133c76d32 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:51.892242 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-ee17dbd2-67c2-467b-a1ac-adf133c76d32 admin admin] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:51.892657 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-ee17dbd2-67c2-467b-a1ac-adf133c76d32 admin admin] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:51.925519 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-ee17dbd2-67c2-467b-a1ac-adf133c76d32 admin admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.147673 May 17 17:19:51.926252 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 36/70] 10.222.0.88 () {60 vars in 1193 bytes} [Tue May 17 17:19:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 17:19:52.826648 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-fa6f70a8-ff8b-415c-a5e2-259a5e93a263 admin admin] Calling method '>' {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:52.827679 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-fa6f70a8-ff8b-415c-a5e2-259a5e93a263 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 May 17 17:19:52.828074 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 35/71] 10.222.0.88 () {56 vars in 1074 bytes} [Tue May 17 17:19:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:19:53.015341 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-51bdf9ce-4197-4122-841c-03fc083b6299 admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:19:53.016555 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 17:19:53.016555 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: warnings.warn(msg) May 17 17:19:53.017734 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-51bdf9ce-4197-4122-841c-03fc083b6299 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:53.018178 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-51bdf9ce-4197-4122-841c-03fc083b6299 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:53.018966 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-51bdf9ce-4197-4122-841c-03fc083b6299 admin admin] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:19:53.019393 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-51bdf9ce-4197-4122-841c-03fc083b6299 admin admin] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:19:53.039036 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-51bdf9ce-4197-4122-841c-03fc083b6299 admin admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.073462 May 17 17:19:53.039891 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 37/72] 10.222.0.88 () {60 vars in 1193 bytes} [Tue May 17 17:19:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 17:20:04.334279 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-fa6f70a8-ff8b-415c-a5e2-259a5e93a263 admin admin] Calling method '>' {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:20:04.335265 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-fa6f70a8-ff8b-415c-a5e2-259a5e93a263 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 May 17 17:20:04.335681 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 36/73] 10.222.0.88 () {56 vars in 1074 bytes} [Tue May 17 17:20:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:20:04.522322 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-13420431-f6ba-4664-b1dd-6958cb415523 admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:20:04.523481 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 17:20:04.523481 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: warnings.warn(msg) May 17 17:20:04.525240 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-13420431-f6ba-4664-b1dd-6958cb415523 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:20:04.525666 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-13420431-f6ba-4664-b1dd-6958cb415523 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:20:04.526434 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-13420431-f6ba-4664-b1dd-6958cb415523 admin admin] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:20:04.526849 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-13420431-f6ba-4664-b1dd-6958cb415523 admin admin] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:20:04.551461 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-13420431-f6ba-4664-b1dd-6958cb415523 admin admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079463 May 17 17:20:04.551966 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 38/74] 10.222.0.88 () {60 vars in 1193 bytes} [Tue May 17 17:20:04 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:20:05.444087 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: DEBUG nova.api.openstack.wsgi [None req-fa6f70a8-ff8b-415c-a5e2-259a5e93a263 admin admin] Calling method '>' {{(pid=103257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:20:05.445079 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: INFO nova.api.openstack.requestlog [None req-fa6f70a8-ff8b-415c-a5e2-259a5e93a263 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 17 17:20:05.445476 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: [pid: 103257|app: 0|req: 37/75] 10.222.0.88 () {56 vars in 1074 bytes} [Tue May 17 17:20:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:20:05.631790 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG nova.api.openstack.wsgi [None req-cf6e5ce4-4119-4c28-aa4c-fcf2d7146a96 admin admin] Calling method '>' {{(pid=103256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:20:05.632951 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 17:20:05.632951 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: warnings.warn(msg) May 17 17:20:05.634633 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-cf6e5ce4-4119-4c28-aa4c-fcf2d7146a96 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:20:05.635098 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-cf6e5ce4-4119-4c28-aa4c-fcf2d7146a96 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:20:05.635935 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-cf6e5ce4-4119-4c28-aa4c-fcf2d7146a96 admin admin] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:20:05.636357 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: DEBUG oslo_concurrency.lockutils [None req-cf6e5ce4-4119-4c28-aa4c-fcf2d7146a96 admin admin] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:20:05.658627 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: INFO nova.api.openstack.requestlog [None req-cf6e5ce4-4119-4c28-aa4c-fcf2d7146a96 admin admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077590 May 17 17:20:05.659168 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: [pid: 103256|app: 0|req: 39/76] 10.222.0.88 () {60 vars in 1193 bytes} [Tue May 17 17:20:05 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:21:06.194325 dv-cinder-842142-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 17 17:21:06.195075 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: Tue May 17 17:21:06 2022 - graceful shutdown triggered... May 17 17:21:06.196312 dv-cinder-842142-1-iscsi devstack@n-api.service[103256]: Gracefully killing worker 1 (pid: 103256)... May 17 17:21:06.196740 dv-cinder-842142-1-iscsi devstack@n-api.service[103257]: Gracefully killing worker 2 (pid: 103257)... May 17 17:21:07.196055 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: worker 1 buried after 1 seconds May 17 17:21:07.197840 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: worker 2 buried after 1 seconds May 17 17:21:07.197840 dv-cinder-842142-1-iscsi devstack@n-api.service[103255]: goodbye to uWSGI. May 17 17:21:07.197585 dv-cinder-842142-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 17 17:21:07.198386 dv-cinder-842142-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 17 17:21:07.201129 dv-cinder-842142-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 17 17:21:07.218038 dv-cinder-842142-1-iscsi devstack@n-api.service[117594]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 17 17:21:07.233508 dv-cinder-842142-1-iscsi devstack@n-api.service[117594]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 17 17:21:07 2022] *** May 17 17:21:07.233508 dv-cinder-842142-1-iscsi devstack@n-api.service[117594]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 17 17:21:07.233508 dv-cinder-842142-1-iscsi devstack@n-api.service[117594]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 17 17:21:07.233508 dv-cinder-842142-1-iscsi devstack@n-api.service[117594]: nodename: dv-cinder-842142-1-iscsi May 17 17:21:07.233508 dv-cinder-842142-1-iscsi devstack@n-api.service[117594]: machine: x86_64 May 17 17:21:07.233508 dv-cinder-842142-1-iscsi devstack@n-api.service[117594]: clock source: unix May 17 17:21:07.233508 dv-cinder-842142-1-iscsi devstack@n-api.service[117594]: pcre jit disabled May 17 17:21:07.233508 dv-cinder-842142-1-iscsi devstack@n-api.service[117594]: detected number of CPU cores: 4 May 17 17:21:07.233508 dv-cinder-842142-1-iscsi devstack@n-api.service[117594]: current working directory: / May 17 17:21:07.233508 dv-cinder-842142-1-iscsi devstack@n-api.service[117594]: detected binary path: /usr/bin/uwsgi-core May 17 17:21:07.233508 dv-cinder-842142-1-iscsi devstack@n-api.service[117594]: your processes number limit is 47680 May 17 17:21:07.233508 dv-cinder-842142-1-iscsi devstack@n-api.service[117594]: your memory page size is 4096 bytes May 17 17:21:07.234508 dv-cinder-842142-1-iscsi devstack@n-api.service[117594]: detected max file descriptor number: 2048 May 17 17:21:07.234508 dv-cinder-842142-1-iscsi devstack@n-api.service[117594]: lock engine: pthread robust mutexes May 17 17:21:07.234508 dv-cinder-842142-1-iscsi devstack@n-api.service[117594]: thunder lock: enabled May 17 17:21:07.234508 dv-cinder-842142-1-iscsi devstack@n-api.service[117594]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 17 17:21:07.234508 dv-cinder-842142-1-iscsi devstack@n-api.service[117594]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 17 17:21:07.283816 dv-cinder-842142-1-iscsi devstack@n-api.service[117594]: Python main interpreter initialized at 0x564453eec9c0 May 17 17:21:07.283816 dv-cinder-842142-1-iscsi devstack@n-api.service[117594]: python threads support enabled May 17 17:21:07.283816 dv-cinder-842142-1-iscsi devstack@n-api.service[117594]: your server socket listen backlog is limited to 100 connections May 17 17:21:07.283816 dv-cinder-842142-1-iscsi devstack@n-api.service[117594]: your mercy for graceful operations on workers is 90 seconds May 17 17:21:07.284248 dv-cinder-842142-1-iscsi devstack@n-api.service[117594]: mapped 403077 bytes (393 KB) for 2 cores May 17 17:21:07.284248 dv-cinder-842142-1-iscsi devstack@n-api.service[117594]: *** Operational MODE: preforking *** May 17 17:21:07.284525 dv-cinder-842142-1-iscsi devstack@n-api.service[117594]: *** uWSGI is running in multiple interpreter mode *** May 17 17:21:07.284525 dv-cinder-842142-1-iscsi devstack@n-api.service[117594]: spawned uWSGI master process (pid: 117594) May 17 17:21:07.284736 dv-cinder-842142-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 17 17:21:07.287581 dv-cinder-842142-1-iscsi devstack@n-api.service[117594]: spawned uWSGI worker 1 (pid: 117611, cores: 1) May 17 17:21:07.287581 dv-cinder-842142-1-iscsi devstack@n-api.service[117594]: spawned uWSGI worker 2 (pid: 117612, cores: 1) May 17 17:21:07.287581 dv-cinder-842142-1-iscsi devstack@n-api.service[117594]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 17 17:21:08.511394 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 17 17:21:08.512423 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 17 17:21:09.312047 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 17:21:09.312047 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: from cryptography.utils import int_from_bytes May 17 17:21:09.312373 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 17:21:09.312373 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: from cryptography.utils import int_from_bytes May 17 17:21:09.312727 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 17:21:09.312727 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: from cryptography.utils import int_from_bytes May 17 17:21:09.312888 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 17:21:09.312888 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: from cryptography.utils import int_from_bytes May 17 17:21:11.791487 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 17:21:11.792172 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 17:21:11.792280 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 17:21:11.792632 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 17:21:11.792894 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 17:21:11.793011 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 17:21:11.793376 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 17:21:11.793531 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.793613 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.793723 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 17:21:11.793920 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.794094 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 17:21:11.794227 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.794338 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 17:21:11.794583 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.794770 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.794876 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.795070 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.795187 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.795396 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.795501 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.795750 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.795862 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.796090 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.796192 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.796405 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.796500 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.796733 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.796844 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842142-1-iscsi {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.797054 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.797146 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.797367 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.797474 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.797640 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.797740 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.797963 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.798065 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.798281 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.798372 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842142-1-iscsi {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.798604 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.798707 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.798916 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.799021 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.799228 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.799422 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.799588 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.799878 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.800008 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.800188 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.800307 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.800502 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.800629 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.800844 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.801010 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.801156 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.801329 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.801483 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.801650 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.801783 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.801967 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.802082 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.802308 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.802428 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.802641 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.802765 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.802962 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.803080 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842142-1-iscsi {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.803283 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.803409 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.803611 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.803786 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.803939 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.804098 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.804253 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.804414 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.804654 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842142-1-iscsi {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.804793 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.805002 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.805129 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.805323 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.805500 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.805644 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.805847 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.805986 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.806210 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.806304 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.806544 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.806673 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.806933 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.807267 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.807493 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.807652 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.807848 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.807972 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.808177 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.808284 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.808496 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.808602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.808813 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.808930 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.809129 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.809239 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.809850 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.811159 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.811159 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.811332 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.811413 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.811499 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.811499 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.812643 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.812751 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.812826 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.812826 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.812983 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.813063 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.813135 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.813214 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.813292 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.813292 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.813827 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.813971 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.814121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.814447 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.814609 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.814787 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.814940 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.815084 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.815224 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.815372 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.815558 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.815732 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.815879 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.816028 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.816178 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.816326 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.816480 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.816629 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.816776 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.816916 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.817095 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.817246 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.817415 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.817568 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.817710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.817859 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.817999 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.818165 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.818318 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.818467 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.818607 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.818791 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.818951 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.818951 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.819335 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.88 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.819335 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.88 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.821125 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.821272 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.821413 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.88 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.821582 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.821731 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.88 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.821877 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.822017 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.822157 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.822301 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.822456 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.822603 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.822759 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.822901 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.823050 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.823190 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.823345 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.823503 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.823670 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.823670 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.823670 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.823670 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.823670 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.823670 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.823670 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.823670 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.824754 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.824754 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.824754 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.824754 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.824754 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.825516 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.825655 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.825803 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.825949 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.825949 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.826230 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.826377 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.826525 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.826678 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.826823 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.826962 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.827101 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.827249 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.827417 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.827631 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.827791 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.827940 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.828080 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.828220 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.828372 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.828520 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.828669 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.828816 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.828955 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.829130 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.829293 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.829442 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.829581 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.829730 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.829878 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.830026 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.830172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.830319 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.830460 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.830611 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.830751 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.830998 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.831255 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.831409 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.831570 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.831730 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.831878 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.832028 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.832167 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.832306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.832455 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.832602 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.832887 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.833037 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.833157 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.833266 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.833389 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.833509 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.833619 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.833739 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.833854 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.833974 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.834096 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.834205 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.834205 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.834430 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.834548 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.834666 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.834781 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.834890 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.834996 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.835116 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.835232 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.835348 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.835464 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.835607 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.836331 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.839304 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.839440 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.839642 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.839746 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.839840 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.839935 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.840031 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.840142 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.840228 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.840311 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.840394 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.840490 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.840582 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.840666 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.840756 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.840756 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.840924 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.841092 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.841181 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.841326 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.841461 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.841551 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.841648 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.841740 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.841835 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.841927 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.842011 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.842140 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.842243 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.842329 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.842458 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.842549 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.842643 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.842727 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.842819 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.842955 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.843043 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.843172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.843258 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.843347 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.843489 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.843662 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:21:11.843751 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.843841 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.843925 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.844021 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.844184 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.844335 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.844487 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.844634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.844634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.844634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.845050 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.845201 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.845360 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.845500 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.845500 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.845790 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.845944 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.846213 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.846368 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.846518 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.846659 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.846806 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.846968 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.847121 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.847269 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.847447 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.847672 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.847825 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.847980 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.848129 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.848279 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.848428 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.848569 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.848723 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.848872 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.849013 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.849267 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.849430 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.849582 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.849734 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.849884 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.850033 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.850172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.850356 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.850452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.850616 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.850703 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.850795 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.850946 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.851099 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.851258 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.851443 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.851647 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.851790 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.851919 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.852007 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.852135 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.852227 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.852355 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.852355 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.852521 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.852659 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.852825 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.852929 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.853166 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.853306 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.853482 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.853583 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.853799 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.853899 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.854458 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.854581 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.854670 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.854763 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.854861 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.854956 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.855042 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.855147 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.855369 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.855566 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.855732 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.855871 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.856008 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.856176 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.856327 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.856551 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.856692 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.856905 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.857066 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.857253 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.857409 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.857571 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.857719 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.857866 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.858006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.858153 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.858326 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.858487 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.858628 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.858768 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.858916 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.859067 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.859290 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.859453 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.859660 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.859803 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.859943 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.860083 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.860240 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.860381 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.860521 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.860669 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.860816 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.860958 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.861126 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.861274 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.861423 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.861571 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.861740 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.861898 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.862147 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.862295 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.862508 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.862673 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.862814 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.862962 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.863112 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.863264 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.863413 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.863842 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.864016 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.864173 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.864314 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.864455 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.864602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.864750 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.864897 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.865053 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.865191 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.865341 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.865481 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.865619 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.865757 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.865909 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.866050 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.866198 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.866338 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.866476 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.866711 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.866872 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.867021 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.867140 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.867255 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.867420 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.870476 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.870648 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.870772 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.870887 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.870972 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.871053 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.871140 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.871221 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.871295 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.871365 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.871446 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.871540 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.871631 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.871713 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.871801 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.871892 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.871976 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.872075 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.872188 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.872269 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.872341 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.872417 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.872488 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.872568 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.872665 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.872757 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.872833 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.872833 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.872960 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.873039 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.873111 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.873218 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.873293 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.873364 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.873434 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.873538 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.873621 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.873700 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.873771 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.873840 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.873919 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.873999 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.874346 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.874487 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.874582 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.874676 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.874838 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.874981 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.875140 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.875267 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.875462 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.875616 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.875840 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.875941 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.876163 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.876276 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.876486 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.876588 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.876803 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.876904 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.877119 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.877218 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.877435 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.877525 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.877752 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.877845 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.878062 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.878153 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.878384 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.878473 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.878713 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.878807 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.879035 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.879142 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.879371 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.879658 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.879818 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.879959 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.880107 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.880247 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.880386 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.880544 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.880717 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.880885 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.881030 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.881168 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.881307 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.881455 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.881607 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.881746 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.881964 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.882121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.882294 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.882449 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.883129 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.883295 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.883441 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.883639 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.883799 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.883942 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.884082 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.884323 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.884472 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.884785 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.885086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.885236 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.885420 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.885640 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.885797 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.885944 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.886095 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.886242 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.886390 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.886548 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.886690 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.886841 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.886996 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.887146 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.887294 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.887433 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.887646 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.887854 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.888096 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.888437 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.888780 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.889017 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.889175 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.889353 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.889510 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.889679 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.889836 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.890012 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.890179 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.890334 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.891094 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.891398 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.891581 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.891747 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.891890 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.892029 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.892169 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.892310 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.892457 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.892606 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.892746 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.892894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.893116 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.893269 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.893411 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.893570 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.893720 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.893867 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.894016 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.894156 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.894327 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.894488 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.894630 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.894769 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.894936 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.895085 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.895235 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.895385 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.895562 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.895724 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.895865 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.896011 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.896228 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.896370 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.896519 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.896666 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.896820 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.896967 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.897121 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.897261 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.897414 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.897584 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.897726 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.897872 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.898022 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.898215 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.898858 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.899012 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.899152 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.899301 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.899449 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.899623 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.899776 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.899916 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.900441 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.900620 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.900767 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.900907 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.901058 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.901197 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.901337 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.901491 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.901639 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.901781 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.901922 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.902071 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.902226 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.902375 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.902516 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.902665 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.902807 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.902955 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.903165 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.903320 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.903470 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.903634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.903787 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.903939 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.904094 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.904245 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.904385 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.904533 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.904682 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.904829 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.904829 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.905383 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.905532 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.905679 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.905819 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.905960 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.906109 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.906257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.906407 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.906547 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.906547 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.906822 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.906963 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.907103 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.907251 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.907397 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.907590 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.907748 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.907904 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.908046 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.908204 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.908353 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.908502 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.908650 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.908790 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.908929 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.909083 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.909224 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.909371 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.909582 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.909739 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.909888 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.910096 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.910274 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.910429 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.910571 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.910725 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.910866 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.911007 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.911147 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.911288 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.911437 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.911600 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.911744 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.911896 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.912045 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.912204 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.912361 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.912511 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.912658 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.912799 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.912946 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.913156 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.913313 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.913465 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.913607 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.913754 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.913933 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.914075 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.914240 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.914394 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.914627 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.914771 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.914771 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.914995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.915114 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.915225 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.915334 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.915602 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.921829 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.922013 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.922179 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.922329 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.922471 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.922620 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.922768 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.922930 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.923079 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.923228 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.923370 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.923582 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.923745 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.923890 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.923890 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.923890 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.923890 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.923890 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.923890 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.923890 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.923890 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.925072 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.925222 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.925222 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.925513 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.925663 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.925804 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.925945 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.926103 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.926244 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.926396 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.926545 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.926694 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.926835 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.926983 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.927137 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.927286 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.927500 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.927500 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.927833 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.927976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.928142 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.928334 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.928506 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.928723 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.928907 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.929062 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.929212 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.929361 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.930024 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.930174 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.930174 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.930442 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.930605 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.930747 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.930888 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.931037 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.931178 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.931178 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.931459 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.931651 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.931900 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.932049 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.932200 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.932358 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.932502 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.932654 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.932803 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.932976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.933121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.933279 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.933456 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.933603 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.933603 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.933879 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.934034 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.934189 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.934331 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.934471 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.934626 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.934767 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.934917 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.935058 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.935199 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.935340 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.935480 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.935699 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.935865 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.935865 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.935865 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.935865 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.935865 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.935865 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.935865 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.935865 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.936963 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.936963 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.936963 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.936963 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.936963 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.936963 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.936963 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.936963 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.938036 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.938036 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.938036 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.938036 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.938036 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.938036 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.938036 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.938999 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.939295 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.939295 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.939609 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.939769 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.939769 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.940059 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.940221 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.940363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.940505 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.940505 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.940780 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.940932 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.941117 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.941260 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.941408 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.941557 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.941707 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.941864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.942165 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.942347 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.942347 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.942633 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.942788 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.942930 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.943073 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.943258 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.943416 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.943583 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.943748 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.943890 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.944038 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.944179 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.944362 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.944362 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.944647 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.944798 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.944946 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.945144 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.945782 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.945782 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.946489 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.946656 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.946800 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.946800 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.946800 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.947342 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.947458 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.950783 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.950938 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.951091 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.951240 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.951396 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.951677 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.951829 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.951970 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.952141 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.952425 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.952597 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.952774 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.952929 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.953144 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.953299 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.953443 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.953605 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.953754 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.953754 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.954087 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.954249 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.954410 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.954410 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.954703 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.954857 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.955005 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.955192 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.955359 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.955524 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.955681 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.955840 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.956017 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.956017 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.956403 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.956554 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.956709 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.956908 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.957061 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.957243 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.957405 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.957562 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.957710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.957858 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.958004 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.958366 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.958544 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.958763 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.958917 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.959065 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.959223 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.959386 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.959595 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.959762 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.959911 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.960058 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.960204 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.960397 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.960553 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.960735 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.960735 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.961064 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.961223 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.961419 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.961575 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.961723 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.961877 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.962032 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.962222 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.962500 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.962662 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.962818 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.962966 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.963122 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.963285 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.963444 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.964201 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.964377 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.964570 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.964733 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.964892 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.965081 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.965235 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.965422 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.965575 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.965734 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.965893 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.966049 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.966226 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.966382 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.966539 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.966706 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.966865 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.967020 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.967176 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.967323 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.967470 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.967658 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.967891 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.968049 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.968206 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.968372 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.968643 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.968891 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.969088 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.969244 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.969409 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.969409 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.969700 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.969861 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.970021 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.970225 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.983236 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.983549 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.983549 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.983888 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.984053 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.984205 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.984372 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.984372 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.984681 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.984830 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.984830 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.985119 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.985300 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.985467 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.985695 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.985857 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.986014 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.986314 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.986491 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.986650 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.986800 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.986800 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.987082 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.987237 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.987398 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.987660 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.987819 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.987997 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.988146 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.988302 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.988458 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.988615 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.988781 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.988934 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.988934 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.989246 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.989407 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.989666 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.990018 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.990174 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.990400 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.990569 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.990720 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.990868 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.991017 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.991174 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.991322 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.991322 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.991691 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.991855 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.992517 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.992677 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.992677 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.992984 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.993143 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.993334 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.993496 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.993652 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.993813 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.993970 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.994191 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.994355 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.994512 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.994694 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.994859 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.994859 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.995154 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.995302 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.995302 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.995617 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.995928 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.996089 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.996239 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.996385 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.996532 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.996679 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.996841 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.996990 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.997157 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.997307 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.997454 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.997615 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.997888 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.998037 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.998194 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.998344 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.998499 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.998659 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.998841 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.998841 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.999146 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.999296 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.999442 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.999649 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:11.999920 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.000257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.000414 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.000563 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.000719 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.000882 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.001078 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.001234 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.001444 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.001609 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.001772 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.001927 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.002168 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.002327 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.004398 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.004576 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.004787 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.004943 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.005099 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.005281 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.005436 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.005594 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.005805 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.006084 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.006237 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.006384 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.006504 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.006504 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.006728 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.006875 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.007000 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.007112 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.007232 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.007232 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.007461 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.008126 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.012289 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.012516 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.012516 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.012824 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.012983 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.013166 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.013320 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.013467 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.013623 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.013780 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.013937 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.014105 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.014254 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.014401 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.014588 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.014752 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.014902 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.015321 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.015573 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.015734 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.015897 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.016048 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.016205 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.016374 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.016533 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.016692 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.016854 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.017003 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.017152 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.017318 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.017476 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.017633 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.017782 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.017929 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.018077 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.018236 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.018393 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.018793 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.019027 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.019190 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.019375 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.019559 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.019717 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.019879 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.020140 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.020306 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.020685 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.020842 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.021216 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.021390 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.021540 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.021696 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.021851 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.022008 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.022165 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.022165 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.022466 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.022614 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.022804 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.022959 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.023152 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.023312 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.023312 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.023733 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.023916 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.024067 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.024067 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.024371 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.024520 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.024676 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.024824 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.024981 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.025137 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.025297 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.025445 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.025606 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.025762 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.025920 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.026067 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.026215 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.026372 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.026522 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.026670 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.026857 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.027021 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.027177 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.027343 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.027536 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.027694 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.027859 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.028016 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.028197 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.028345 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.028492 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.028654 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.028812 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.028960 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.029107 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.029107 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.029107 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.029107 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.029107 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.029107 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.029107 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.030459 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.030972 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.031142 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.031293 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.031444 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.031657 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.031812 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.031983 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.032147 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.032296 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.032296 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.032592 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.032747 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.032747 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.033047 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.033195 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.033195 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.033483 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.033631 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.033631 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.034017 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.034166 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.034313 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.034469 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.034624 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.034786 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.034944 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.035093 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.035239 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.035388 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.035554 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.035721 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.035871 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.036044 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.036201 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.036367 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.036525 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.036682 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.036836 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.036986 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.037134 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.037283 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.037439 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.037588 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.037743 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.037908 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.038066 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.038221 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.038380 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.038530 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.038677 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.038858 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.039046 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.039216 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.039364 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.039529 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.039529 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.039876 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.040053 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.040439 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.040614 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.040786 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.041210 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.041370 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.041520 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.041698 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.041964 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.041964 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.042274 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.042421 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.042593 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.042743 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.042743 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.043031 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.043186 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.043343 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.043506 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.043967 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.043967 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.044311 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.044462 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.044617 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.044788 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.044937 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.045093 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.045284 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.045438 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.045601 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.045750 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.045898 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.046046 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.046194 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.046378 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.046546 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.046695 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.046853 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.047001 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.047188 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.047388 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.047672 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.047672 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.047995 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.048143 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.048298 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.048448 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.048641 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.048795 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.048954 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.049109 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.049265 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.049421 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.049610 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.049798 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.049951 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.050098 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.050245 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.050407 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.050407 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.050854 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.051015 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.051373 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.051601 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.051808 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.051968 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.052117 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.052117 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.052405 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.052562 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.052712 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.052712 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.053064 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.053213 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.053380 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.053538 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.053538 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.053837 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.053985 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.054140 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.054288 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.054288 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.055145 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.055332 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.055488 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.055669 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.055819 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.055819 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.056159 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.056308 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.056456 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.056610 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.056766 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.056766 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.057112 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.057263 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.057418 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.057574 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.057731 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.057897 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.058047 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.058194 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.058342 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.058489 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.058646 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.058801 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.058956 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.059155 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.059317 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.059476 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.059659 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.059810 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.059975 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.060134 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.060290 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.060452 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.060606 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.060841 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.060997 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.061175 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.061523 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.061695 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.061845 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.061993 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.062140 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.062300 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.062447 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.062604 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.062752 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.062898 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.063058 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.063269 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.063439 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.063671 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.063671 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.063991 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.064145 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.064145 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.064452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.064609 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.064758 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.064912 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.065067 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.065254 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.065486 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.065638 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.065785 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.065932 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.066087 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.066234 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.066407 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.066565 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.066713 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.066879 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.067034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.067260 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.067417 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.067594 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.067594 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.067594 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.068032 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.068196 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.068344 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.068505 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.068660 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.068808 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.068963 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.069126 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.069281 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.069467 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.069624 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.069772 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.069919 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.070746 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.071140 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.071433 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.071955 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.072174 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.072174 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.072612 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.072836 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.072836 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.073151 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.073299 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.073490 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.073652 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.073802 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.073949 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.074117 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.074269 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.074426 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.074583 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.074583 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.074876 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.075050 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.075331 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.075555 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.075555 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.075868 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.076018 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.076166 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.076351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.076601 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.076769 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.076935 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.077096 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.077253 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.077410 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.077598 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.077752 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.077908 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.078064 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.078220 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.078389 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.078553 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.078702 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.078849 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.078996 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.079152 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.079346 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.079500 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.079736 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.079894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.080083 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.080250 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.080408 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.080566 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.080715 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.080870 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.081018 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.081293 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.081458 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.081608 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.081764 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.082175 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.082354 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.082504 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.082660 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.082828 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.082977 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.083126 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.083282 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.083431 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.083635 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.083788 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.083938 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.084085 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.084255 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.084412 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.084561 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.084708 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.084866 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 17:21:12.085030 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.085030 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.085030 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.085030 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.085030 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.085030 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.085030 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.085030 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.086242 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.086242 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.086242 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.086242 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.086242 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.086242 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.086242 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.086242 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.087381 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.087381 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.087381 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.087381 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.087381 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.087381 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.087381 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.087381 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.088581 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.088581 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.088581 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.088581 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.088581 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.088581 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.088581 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.088581 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.089682 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.089682 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.089682 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.089682 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.089682 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.089682 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.089682 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.089682 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.090943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.090943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.090943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.090943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.090943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.090943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.090943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.090943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.092385 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.092385 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.092385 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.092385 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.092385 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.092385 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.092385 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.092385 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.093632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.093632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.093632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.093632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.093632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.093632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.093632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.093632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.094812 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.094812 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.094812 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.094812 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.094812 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.094812 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.094812 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.094812 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.096001 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.096001 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.096001 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.096001 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.096001 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.096001 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.096001 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.096001 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.097261 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_db.sqlalchemy.engines [None req-cb5b3140-1073-4632-9208-aa1da9e68576 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:21:12.097424 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.097424 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.097424 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.097424 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.097424 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.097424 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:21:12.097424 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 17:21:12.109600 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_db.sqlalchemy.engines [None req-fd694b31-826a-4df9-b6c5-436be11ab948 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:21:12.149436 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.context [None req-cb5b3140-1073-4632-9208-aa1da9e68576 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),598e0022-4d13-47ae-9073-352b20e59bd0(cell1) {{(pid=117612) load_cells /opt/stack/nova/nova/context.py:464}} May 17 17:21:12.153822 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cb5b3140-1073-4632-9208-aa1da9e68576 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:12.155683 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cb5b3140-1073-4632-9208-aa1da9e68576 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:12.156497 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cb5b3140-1073-4632-9208-aa1da9e68576 None None] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:12.158496 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cb5b3140-1073-4632-9208-aa1da9e68576 None None] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:12.170006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_db.sqlalchemy.engines [None req-cb5b3140-1073-4632-9208-aa1da9e68576 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:21:12.172340 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_db.sqlalchemy.engines [None req-cb5b3140-1073-4632-9208-aa1da9e68576 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:21:12.176539 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.context [None req-fd694b31-826a-4df9-b6c5-436be11ab948 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),598e0022-4d13-47ae-9073-352b20e59bd0(cell1) {{(pid=117611) load_cells /opt/stack/nova/nova/context.py:464}} May 17 17:21:12.181469 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fd694b31-826a-4df9-b6c5-436be11ab948 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:12.183095 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fd694b31-826a-4df9-b6c5-436be11ab948 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:12.189441 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fd694b31-826a-4df9-b6c5-436be11ab948 None None] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:21:12.189441 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fd694b31-826a-4df9-b6c5-436be11ab948 None None] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:21:12.197935 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_db.sqlalchemy.engines [None req-fd694b31-826a-4df9-b6c5-436be11ab948 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:21:12.199743 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_db.sqlalchemy.engines [None req-fd694b31-826a-4df9-b6c5-436be11ab948 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:21:12.333053 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_db.sqlalchemy.engines [None req-cb5b3140-1073-4632-9208-aa1da9e68576 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:21:12.360306 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_db.sqlalchemy.engines [None req-fd694b31-826a-4df9-b6c5-436be11ab948 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:21:12.654700 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: WARNING keystonemiddleware.auth_token [None req-cb5b3140-1073-4632-9208-aa1da9e68576 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 17:21:12.662662 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: WARNING keystonemiddleware.auth_token [None req-cb5b3140-1073-4632-9208-aa1da9e68576 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 17:21:12.688801 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: WARNING keystonemiddleware.auth_token [None req-fd694b31-826a-4df9-b6c5-436be11ab948 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 17:21:12.696999 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: WARNING keystonemiddleware.auth_token [None req-fd694b31-826a-4df9-b6c5-436be11ab948 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 17:21:13.006429 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: WARNING keystonemiddleware.auth_token [None req-cb5b3140-1073-4632-9208-aa1da9e68576 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 17:21:13.012640 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: WARNING keystonemiddleware.auth_token [None req-cb5b3140-1073-4632-9208-aa1da9e68576 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 17:21:13.018403 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564453eec9c0 pid: 117612 (default app) May 17 17:21:13.049151 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: WARNING keystonemiddleware.auth_token [None req-fd694b31-826a-4df9-b6c5-436be11ab948 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 17:21:13.055353 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: WARNING keystonemiddleware.auth_token [None req-fd694b31-826a-4df9-b6c5-436be11ab948 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 17:21:13.060721 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564453eec9c0 pid: 117611 (default app) May 17 17:21:56.785026 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-94c85c8f-99f4-454d-b919-1d2c45560546 tempest-VolumesNegativeTest-1742642746 tempest-VolumesNegativeTest-1742642746-project] Action: 'create', calling method: .version_select at 0x7f73d1831280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1185382705", "metadata": {"Type": "work"}}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:21:56.809362 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-94c85c8f-99f4-454d-b919-1d2c45560546 tempest-VolumesNegativeTest-1742642746 tempest-VolumesNegativeTest-1742642746-project] Request method failure captured: May 17 17:21:56.809362 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 17 17:21:56.809362 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 17 17:21:56.809362 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 17 17:21:56.809362 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Connection: close May 17 17:21:56.809362 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Length: 122 May 17 17:21:56.809362 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 17 17:21:56.809362 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.88 May 17 17:21:56.809362 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 17 17:21:56.809362 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 17 17:21:56.809362 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABig9mzJoAd8GiI6PCm_8AQSZn-YMnFl-FbM1SBLEJa8mxDPNAt8x_iSmUn139-jPTAJqVV5LIYzD7nKa1307wAiUuxRlZLGeVr2xMVUFyqLUHJkYQ_6qoRbwDo9uqAICIbQI0f-lcDTVkl5RPdPtKwPhvL8ybq2_JzimrWRJQ_y-wEfSQ May 17 17:21:56.809362 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 17 17:21:56.809362 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 17 17:21:56.809362 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 17 17:21:56.809362 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 17 17:21:56.809362 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 17 17:21:56.809362 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 17 17:21:56.809362 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 8e6d164baa864905bb74e05742739765 May 17 17:21:56.809362 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-VolumesNegativeTest-1742642746 May 17 17:21:56.809362 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Role: reader,member May 17 17:21:56.809362 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Roles: reader,member May 17 17:21:56.820818 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8e6d164baa864905bb74e05742739765"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8e6d164baa864905bb74e05742739765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8e6d164baa864905bb74e05742739765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8e6d164baa864905bb74e05742739765", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:21:56.820818 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-VolumesNegativeTest-1742642746 May 17 17:21:56.820818 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 8e6d164baa864905bb74e05742739765 May 17 17:21:56.820818 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-VolumesNegativeTest-1742642746 May 17 17:21:56.820818 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User: tempest-VolumesNegativeTest-1742642746-project May 17 17:21:56.820818 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 17 17:21:56.820818 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 17 17:21:56.820818 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Id: 2e2195ba1ad3427a9a42ba3d73cda493 May 17 17:21:56.820818 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-VolumesNegativeTest-1742642746-project May 17 17:21:56.820818 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: May 17 17:21:56.820818 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1185382705", "metadata": {"Type": "work"}}} May 17 17:21:56.820818 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: method: May 17 17:21:56.820818 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 17 17:21:56.821738 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1185382705', 'metadata': {'Type': 'work'}}}} May 17 17:21:56.821738 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:21:56.821738 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:56.821738 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 17 17:21:56.821738 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 17 17:21:56.821738 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 17 17:21:56.821738 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise error May 17 17:21:56.821738 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 17 17:21:56.821738 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:56.821738 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 17 17:21:56.821738 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 17 17:21:56.821738 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:56.821738 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi On instance['volume']: May 17 17:21:56.821738 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi '#$%' May 17 17:21:56.821738 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:56.821738 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:21:56.821738 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:56.821738 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:56.821738 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:21:56.821738 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:21:56.821738 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:21:56.821738 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:21:56.823136 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 17:21:56.823136 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 17:21:56.823136 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:21:56.823136 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:21:56.823136 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 17 17:21:56.823136 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 17 17:21:56.823136 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 17 17:21:56.823136 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 17 17:21:56.823136 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 17 17:21:56.823136 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 17 17:21:56.823136 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 17 17:21:56.823136 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:56.823136 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:21:56.823136 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:56.823136 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:56.823136 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:21:56.823136 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:21:56.823136 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 17 17:21:56.823136 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 17 17:21:56.824797 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 17 17:21:56.824797 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:56.824797 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-94c85c8f-99f4-454d-b919-1d2c45560546 tempest-VolumesNegativeTest-1742642746 tempest-VolumesNegativeTest-1742642746-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:21:56.824797 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-94c85c8f-99f4-454d-b919-1d2c45560546 tempest-VolumesNegativeTest-1742642746 tempest-VolumesNegativeTest-1742642746-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.501989 May 17 17:21:56.824797 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 1/1] 10.222.0.88 () {60 vars in 1155 bytes} [Tue May 17 17:21:55 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1504 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 17:21:56.827869 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a03779e3-578b-4ce0-bdd7-4f1f24286b63 tempest-VolumesNegativeTest-1742642746 tempest-VolumesNegativeTest-1742642746-project] Action: 'create', calling method: .version_select at 0x7f73d16d65e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-935961458", "metadata": {"Type": "work"}}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:21:56.830530 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a03779e3-578b-4ce0-bdd7-4f1f24286b63 tempest-VolumesNegativeTest-1742642746 tempest-VolumesNegativeTest-1742642746-project] Request method failure captured: May 17 17:21:56.830530 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 17 17:21:56.830530 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 17 17:21:56.830530 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 17 17:21:56.830530 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Connection: close May 17 17:21:56.830530 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Length: 119 May 17 17:21:56.830530 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 17 17:21:56.830530 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.88 May 17 17:21:56.830530 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 17 17:21:56.830530 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 17 17:21:56.830530 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABig9mzJoAd8GiI6PCm_8AQSZn-YMnFl-FbM1SBLEJa8mxDPNAt8x_iSmUn139-jPTAJqVV5LIYzD7nKa1307wAiUuxRlZLGeVr2xMVUFyqLUHJkYQ_6qoRbwDo9uqAICIbQI0f-lcDTVkl5RPdPtKwPhvL8ybq2_JzimrWRJQ_y-wEfSQ May 17 17:21:56.830530 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 17 17:21:56.830530 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 17 17:21:56.830530 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 17 17:21:56.830530 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 17 17:21:56.830530 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 17 17:21:56.830530 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 17 17:21:56.830530 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 8e6d164baa864905bb74e05742739765 May 17 17:21:56.830530 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-VolumesNegativeTest-1742642746 May 17 17:21:56.830530 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Role: reader,member May 17 17:21:56.830530 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Roles: reader,member May 17 17:21:56.832119 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8e6d164baa864905bb74e05742739765"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8e6d164baa864905bb74e05742739765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8e6d164baa864905bb74e05742739765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8e6d164baa864905bb74e05742739765", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:21:56.832119 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-VolumesNegativeTest-1742642746 May 17 17:21:56.832119 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 8e6d164baa864905bb74e05742739765 May 17 17:21:56.832119 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-VolumesNegativeTest-1742642746 May 17 17:21:56.832119 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User: tempest-VolumesNegativeTest-1742642746-project May 17 17:21:56.832119 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 17 17:21:56.832119 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 17 17:21:56.832119 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Id: 2e2195ba1ad3427a9a42ba3d73cda493 May 17 17:21:56.832119 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-VolumesNegativeTest-1742642746-project May 17 17:21:56.832119 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: May 17 17:21:56.832119 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-935961458", "metadata": {"Type": "work"}}} May 17 17:21:56.832119 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: method: May 17 17:21:56.832119 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 17 17:21:56.833065 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-935961458', 'metadata': {'Type': 'work'}}}} May 17 17:21:56.833065 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:21:56.833065 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:56.833065 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 17 17:21:56.833065 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 17 17:21:56.833065 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 17 17:21:56.833065 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise error May 17 17:21:56.833065 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 17 17:21:56.833065 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:56.833065 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 17 17:21:56.833065 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 17 17:21:56.833065 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:56.833065 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi On instance['volume']: May 17 17:21:56.833065 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi '0' May 17 17:21:56.833065 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:56.833065 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:21:56.833065 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:56.833065 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:56.833065 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:21:56.833065 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:21:56.833065 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:21:56.833065 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:21:56.834714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 17:21:56.834714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 17:21:56.834714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:21:56.834714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:21:56.834714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 17 17:21:56.834714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 17 17:21:56.834714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 17 17:21:56.834714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 17 17:21:56.834714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 17 17:21:56.834714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 17 17:21:56.834714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 17 17:21:56.834714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:56.834714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:21:56.834714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:56.834714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:56.834714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:21:56.834714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:21:56.834714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 17 17:21:56.834714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 17 17:21:56.836274 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 17 17:21:56.836274 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:56.836274 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a03779e3-578b-4ce0-bdd7-4f1f24286b63 tempest-VolumesNegativeTest-1742642746 tempest-VolumesNegativeTest-1742642746-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:21:56.841964 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a03779e3-578b-4ce0-bdd7-4f1f24286b63 tempest-VolumesNegativeTest-1742642746 tempest-VolumesNegativeTest-1742642746-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011561 May 17 17:21:56.844607 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 2/2] 10.222.0.88 () {60 vars in 1155 bytes} [Tue May 17 17:21:56 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 17 17:21:56.856123 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5280a506-7eda-4505-8ef3-d714b661b4a5 tempest-VolumesNegativeTest-1742642746 tempest-VolumesNegativeTest-1742642746-project] Action: 'create', calling method: .version_select at 0x7f73d18315e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2055923537", "metadata": {"Type": "work"}}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:21:56.858710 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5280a506-7eda-4505-8ef3-d714b661b4a5 tempest-VolumesNegativeTest-1742642746 tempest-VolumesNegativeTest-1742642746-project] Request method failure captured: May 17 17:21:56.858710 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 17 17:21:56.858710 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 17 17:21:56.858710 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 17 17:21:56.858710 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Connection: close May 17 17:21:56.858710 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Length: 119 May 17 17:21:56.858710 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 17 17:21:56.858710 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.88 May 17 17:21:56.858710 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 17 17:21:56.858710 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 17 17:21:56.858710 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABig9mzJoAd8GiI6PCm_8AQSZn-YMnFl-FbM1SBLEJa8mxDPNAt8x_iSmUn139-jPTAJqVV5LIYzD7nKa1307wAiUuxRlZLGeVr2xMVUFyqLUHJkYQ_6qoRbwDo9uqAICIbQI0f-lcDTVkl5RPdPtKwPhvL8ybq2_JzimrWRJQ_y-wEfSQ May 17 17:21:56.858710 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 17 17:21:56.858710 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 17 17:21:56.858710 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 17 17:21:56.858710 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 17 17:21:56.858710 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 17 17:21:56.858710 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 17 17:21:56.858710 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 8e6d164baa864905bb74e05742739765 May 17 17:21:56.858710 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-VolumesNegativeTest-1742642746 May 17 17:21:56.858710 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Role: reader,member May 17 17:21:56.858710 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Roles: reader,member May 17 17:21:56.860190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8e6d164baa864905bb74e05742739765"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8e6d164baa864905bb74e05742739765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8e6d164baa864905bb74e05742739765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8e6d164baa864905bb74e05742739765", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:21:56.860190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-VolumesNegativeTest-1742642746 May 17 17:21:56.860190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 8e6d164baa864905bb74e05742739765 May 17 17:21:56.860190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-VolumesNegativeTest-1742642746 May 17 17:21:56.860190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User: tempest-VolumesNegativeTest-1742642746-project May 17 17:21:56.860190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 17 17:21:56.860190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 17 17:21:56.860190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Id: 2e2195ba1ad3427a9a42ba3d73cda493 May 17 17:21:56.860190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-VolumesNegativeTest-1742642746-project May 17 17:21:56.860190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: May 17 17:21:56.860190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2055923537", "metadata": {"Type": "work"}}} May 17 17:21:56.860190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: method: May 17 17:21:56.860190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 17 17:21:56.861026 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2055923537', 'metadata': {'Type': 'work'}}}} May 17 17:21:56.861026 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:21:56.861026 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:56.861026 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 17 17:21:56.861026 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 17 17:21:56.861026 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 17 17:21:56.861026 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise error May 17 17:21:56.861026 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 17 17:21:56.861026 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:56.861026 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 17 17:21:56.861026 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 17 17:21:56.861026 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:56.861026 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi On instance['volume']: May 17 17:21:56.861026 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi '' May 17 17:21:56.861026 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:56.861026 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:21:56.861026 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:56.861026 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:56.861026 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:21:56.861026 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:21:56.861026 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:21:56.861026 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:21:56.862473 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 17:21:56.862473 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 17:21:56.862473 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:21:56.862473 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:21:56.862473 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 17 17:21:56.862473 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 17 17:21:56.862473 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 17 17:21:56.862473 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 17 17:21:56.862473 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 17 17:21:56.862473 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 17 17:21:56.862473 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 17 17:21:56.862473 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:56.862473 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:21:56.862473 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:56.862473 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:56.862473 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:21:56.862473 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:21:56.862473 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 17 17:21:56.862473 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 17 17:21:56.863786 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 17 17:21:56.863786 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:56.867997 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5280a506-7eda-4505-8ef3-d714b661b4a5 tempest-VolumesNegativeTest-1742642746 tempest-VolumesNegativeTest-1742642746-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:21:56.870117 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5280a506-7eda-4505-8ef3-d714b661b4a5 tempest-VolumesNegativeTest-1742642746 tempest-VolumesNegativeTest-1742642746-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.019605 May 17 17:21:56.872831 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 3/3] 10.222.0.88 () {60 vars in 1155 bytes} [Tue May 17 17:21:56 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 17:21:56.881674 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3fa358d2-0550-464c-9a78-d71e5b20a281 tempest-VolumesNegativeTest-1742642746 tempest-VolumesNegativeTest-1742642746-project] Calling method '.version_select at 0x7f73d16e5310>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:21:57.189789 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4f6178e7-b030-402a-9ea5-054a07cc42eb tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] Action: 'create', calling method: .version_select at 0x7f73d1832280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1971112208"}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:21:57.659102 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-3fa358d2-0550-464c-9a78-d71e5b20a281 tempest-VolumesNegativeTest-1742642746 tempest-VolumesNegativeTest-1742642746-project] HTTP exception thrown: Volume tempest-invalid-2117301746 could not be found. May 17 17:21:57.663426 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3fa358d2-0550-464c-9a78-d71e5b20a281 tempest-VolumesNegativeTest-1742642746 tempest-VolumesNegativeTest-1742642746-project] Request method failure captured: May 17 17:21:57.663426 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2117301746 HTTP/1.1 May 17 17:21:57.663426 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 17 17:21:57.663426 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 17 17:21:57.663426 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Connection: close May 17 17:21:57.663426 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 17 17:21:57.663426 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 17 17:21:57.663426 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.88 May 17 17:21:57.663426 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 17 17:21:57.663426 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 17 17:21:57.663426 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABig9mzJoAd8GiI6PCm_8AQSZn-YMnFl-FbM1SBLEJa8mxDPNAt8x_iSmUn139-jPTAJqVV5LIYzD7nKa1307wAiUuxRlZLGeVr2xMVUFyqLUHJkYQ_6qoRbwDo9uqAICIbQI0f-lcDTVkl5RPdPtKwPhvL8ybq2_JzimrWRJQ_y-wEfSQ May 17 17:21:57.663426 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 17 17:21:57.663426 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 17 17:21:57.663426 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 17 17:21:57.663426 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 17 17:21:57.663426 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 17 17:21:57.663426 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 17 17:21:57.663426 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 8e6d164baa864905bb74e05742739765 May 17 17:21:57.663426 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-VolumesNegativeTest-1742642746 May 17 17:21:57.663426 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Role: reader,member May 17 17:21:57.663426 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Roles: reader,member May 17 17:21:57.665006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8e6d164baa864905bb74e05742739765"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8e6d164baa864905bb74e05742739765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8e6d164baa864905bb74e05742739765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8e6d164baa864905bb74e05742739765", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:21:57.665006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-VolumesNegativeTest-1742642746 May 17 17:21:57.665006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 8e6d164baa864905bb74e05742739765 May 17 17:21:57.665006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-VolumesNegativeTest-1742642746 May 17 17:21:57.665006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User: tempest-VolumesNegativeTest-1742642746-project May 17 17:21:57.665006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 17 17:21:57.665006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 17 17:21:57.665006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Id: 2e2195ba1ad3427a9a42ba3d73cda493 May 17 17:21:57.665006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-VolumesNegativeTest-1742642746-project May 17 17:21:57.665006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: method: May 17 17:21:57.665006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: exception: Volume tempest-invalid-2117301746 could not be found. May 17 17:21:57.665006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: action_args: {'id': 'tempest-invalid-2117301746'} May 17 17:21:57.665006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:21:57.669821 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:57.669821 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 17:21:57.669821 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 17:21:57.669821 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 17:21:57.669821 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 17:21:57.669821 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 17:21:57.669821 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 17:21:57.669821 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 17:21:57.669821 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 17:21:57.669821 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 17:21:57.669821 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 17:21:57.669821 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:21:57.669821 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:21:57.669821 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:21:57.669821 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:21:57.669821 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2117301746 could not be found. (HTTP 404) (Request-ID: req-b346abd1-df50-4987-944f-e6bf7fe0f007) May 17 17:21:57.669821 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:57.669821 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:21:57.669821 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:57.671400 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:57.671400 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 17 17:21:57.671400 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 17 17:21:57.671400 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 17:21:57.671400 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 17:21:57.671400 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 17:21:57.671400 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 17:21:57.671400 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 17:21:57.671400 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 17:21:57.671400 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 17:21:57.671400 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 17:21:57.671400 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 17:21:57.671400 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 17:21:57.671400 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 17:21:57.671400 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 17:21:57.671400 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 17:21:57.671400 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 17:21:57.671400 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 17:21:57.671400 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 17:21:57.672824 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:21:57.672824 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:21:57.672824 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:21:57.672824 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:21:57.672824 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2117301746 could not be found. May 17 17:21:57.672824 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:57.672824 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:21:57.672824 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:57.672824 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:57.672824 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:21:57.672824 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:21:57.672824 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:21:57.672824 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:21:57.672824 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 17:21:57.672824 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 17:21:57.672824 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:21:57.672824 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:21:57.672824 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 17 17:21:57.672824 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:21:57.672824 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2117301746 could not be found. May 17 17:21:57.674182 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:57.674182 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:21:57.674182 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:57.674182 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:57.674182 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:21:57.674182 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:21:57.674182 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:21:57.674182 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:21:57.674182 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2117301746 could not be found. May 17 17:21:57.674182 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:57.674182 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3fa358d2-0550-464c-9a78-d71e5b20a281 tempest-VolumesNegativeTest-1742642746 tempest-VolumesNegativeTest-1742642746-project] Returning 404 to user: Volume tempest-invalid-2117301746 could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:21:57.674182 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3fa358d2-0550-464c-9a78-d71e5b20a281 tempest-VolumesNegativeTest-1742642746 tempest-VolumesNegativeTest-1742642746-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2117301746" status: 404 len: 99 microversion: 2.1 time: 0.787381 May 17 17:21:57.674182 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 4/4] 10.222.0.88 () {58 vars in 1217 bytes} [Tue May 17 17:21:56 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2117301746 => generated 99 bytes in 789 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 17 17:21:57.680411 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d6c75860-c831-459d-87a9-1ac01693cc10 tempest-VolumesNegativeTest-1742642746 tempest-VolumesNegativeTest-1742642746-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007950 May 17 17:21:57.684743 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 5/5] 10.222.0.88 () {58 vars in 1139 bytes} [Tue May 17 17:21:57 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 17 17:21:57.692266 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3b66af2f-7a24-4554-bbae-c95e1335704a tempest-VolumesNegativeTest-1742642746 tempest-VolumesNegativeTest-1742642746-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005588 May 17 17:21:57.700777 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 6/6] 10.222.0.88 () {58 vars in 1136 bytes} [Tue May 17 17:21:57 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 17 17:21:57.709427 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c78fec27-9390-4dd0-b54a-72fb77a199da tempest-VolumesNegativeTest-1742642746 tempest-VolumesNegativeTest-1742642746-project] Calling method '.version_select at 0x7f73d160e160>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:21:58.381227 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-c78fec27-9390-4dd0-b54a-72fb77a199da tempest-VolumesNegativeTest-1742642746 tempest-VolumesNegativeTest-1742642746-project] HTTP exception thrown: Volume 9e3c3268-e960-4d3c-accf-562ae2e07926 could not be found. May 17 17:21:58.384175 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c78fec27-9390-4dd0-b54a-72fb77a199da tempest-VolumesNegativeTest-1742642746 tempest-VolumesNegativeTest-1742642746-project] Request method failure captured: May 17 17:21:58.384175 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: request: DELETE /compute/v2.1/os-volumes/9e3c3268-e960-4d3c-accf-562ae2e07926 HTTP/1.1 May 17 17:21:58.384175 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 17 17:21:58.384175 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 17 17:21:58.384175 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Connection: close May 17 17:21:58.384175 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 17 17:21:58.384175 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 17 17:21:58.384175 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.88 May 17 17:21:58.384175 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 17 17:21:58.384175 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 17 17:21:58.384175 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABig9mzJoAd8GiI6PCm_8AQSZn-YMnFl-FbM1SBLEJa8mxDPNAt8x_iSmUn139-jPTAJqVV5LIYzD7nKa1307wAiUuxRlZLGeVr2xMVUFyqLUHJkYQ_6qoRbwDo9uqAICIbQI0f-lcDTVkl5RPdPtKwPhvL8ybq2_JzimrWRJQ_y-wEfSQ May 17 17:21:58.384175 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 17 17:21:58.384175 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 17 17:21:58.384175 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 17 17:21:58.384175 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 17 17:21:58.384175 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 17 17:21:58.384175 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 17 17:21:58.384175 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 8e6d164baa864905bb74e05742739765 May 17 17:21:58.384175 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-VolumesNegativeTest-1742642746 May 17 17:21:58.384175 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Role: reader,member May 17 17:21:58.384175 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Roles: reader,member May 17 17:21:58.385572 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8e6d164baa864905bb74e05742739765"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8e6d164baa864905bb74e05742739765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8e6d164baa864905bb74e05742739765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8e6d164baa864905bb74e05742739765", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:21:58.385572 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-VolumesNegativeTest-1742642746 May 17 17:21:58.385572 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 8e6d164baa864905bb74e05742739765 May 17 17:21:58.385572 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-VolumesNegativeTest-1742642746 May 17 17:21:58.385572 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User: tempest-VolumesNegativeTest-1742642746-project May 17 17:21:58.385572 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 17 17:21:58.385572 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 17 17:21:58.385572 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Id: 2e2195ba1ad3427a9a42ba3d73cda493 May 17 17:21:58.385572 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-VolumesNegativeTest-1742642746-project May 17 17:21:58.385572 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: method: May 17 17:21:58.385572 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: exception: Volume 9e3c3268-e960-4d3c-accf-562ae2e07926 could not be found. May 17 17:21:58.385572 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: action_args: {'id': '9e3c3268-e960-4d3c-accf-562ae2e07926'} May 17 17:21:58.385572 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:21:58.386498 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:58.386498 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 17:21:58.386498 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 17:21:58.386498 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 17:21:58.386498 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 17:21:58.386498 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 17:21:58.386498 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 17:21:58.386498 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 17:21:58.386498 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 17:21:58.386498 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 17:21:58.386498 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 17:21:58.386498 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:21:58.386498 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:21:58.386498 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:21:58.386498 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:21:58.386498 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9e3c3268-e960-4d3c-accf-562ae2e07926 could not be found. (HTTP 404) (Request-ID: req-962ad5c6-8c28-4e8f-8264-a5e9f477e46e) May 17 17:21:58.386498 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:58.386498 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:21:58.386498 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:58.387913 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:58.387913 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 17 17:21:58.387913 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 17 17:21:58.387913 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 17:21:58.387913 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 17:21:58.387913 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 17:21:58.387913 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 17:21:58.387913 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 17:21:58.387913 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 17:21:58.387913 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 17:21:58.387913 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 17:21:58.387913 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 17:21:58.387913 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 17:21:58.387913 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 17:21:58.387913 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 17:21:58.387913 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 17:21:58.387913 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 17:21:58.387913 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 17:21:58.387913 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 17:21:58.390621 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:21:58.390621 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:21:58.390621 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:21:58.390621 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:21:58.390621 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9e3c3268-e960-4d3c-accf-562ae2e07926 could not be found. May 17 17:21:58.390621 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:58.390621 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:21:58.390621 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:58.390621 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:58.390621 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:21:58.390621 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:21:58.390621 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:21:58.390621 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:21:58.390621 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 17:21:58.390621 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 17:21:58.390621 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:21:58.390621 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:21:58.390621 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 17 17:21:58.390621 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:21:58.393190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9e3c3268-e960-4d3c-accf-562ae2e07926 could not be found. May 17 17:21:58.393190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:58.393190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:21:58.393190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:58.393190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:58.393190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:21:58.393190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:21:58.393190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:21:58.393190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:21:58.393190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9e3c3268-e960-4d3c-accf-562ae2e07926 could not be found. May 17 17:21:58.393190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:58.393190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c78fec27-9390-4dd0-b54a-72fb77a199da tempest-VolumesNegativeTest-1742642746 tempest-VolumesNegativeTest-1742642746-project] Returning 404 to user: Volume 9e3c3268-e960-4d3c-accf-562ae2e07926 could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:21:58.393190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c78fec27-9390-4dd0-b54a-72fb77a199da tempest-VolumesNegativeTest-1742642746 tempest-VolumesNegativeTest-1742642746-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/9e3c3268-e960-4d3c-accf-562ae2e07926" status: 404 len: 109 microversion: 2.1 time: 0.683862 May 17 17:21:58.393190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 7/7] 10.222.0.88 () {58 vars in 1247 bytes} [Tue May 17 17:21:57 2022] DELETE /compute/v2.1/os-volumes/9e3c3268-e960-4d3c-accf-562ae2e07926 => generated 109 bytes in 689 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:21:58.402319 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-cf54343e-40f5-4823-8105-0270295c7c9a tempest-VolumesNegativeTest-1742642746 tempest-VolumesNegativeTest-1742642746-project] Calling method '.version_select at 0x7f73d160e280>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:21:58.466899 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-cf54343e-40f5-4823-8105-0270295c7c9a tempest-VolumesNegativeTest-1742642746 tempest-VolumesNegativeTest-1742642746-project] HTTP exception thrown: Volume 77d2bee7-fc6e-4c96-9b70-d2bb06ba2dbe could not be found. May 17 17:21:58.469052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-cf54343e-40f5-4823-8105-0270295c7c9a tempest-VolumesNegativeTest-1742642746 tempest-VolumesNegativeTest-1742642746-project] Request method failure captured: May 17 17:21:58.469052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: request: GET /compute/v2.1/os-volumes/77d2bee7-fc6e-4c96-9b70-d2bb06ba2dbe HTTP/1.1 May 17 17:21:58.469052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 17 17:21:58.469052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 17 17:21:58.469052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Connection: close May 17 17:21:58.469052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 17 17:21:58.469052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 17 17:21:58.469052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.88 May 17 17:21:58.469052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 17 17:21:58.469052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 17 17:21:58.469052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABig9mzJoAd8GiI6PCm_8AQSZn-YMnFl-FbM1SBLEJa8mxDPNAt8x_iSmUn139-jPTAJqVV5LIYzD7nKa1307wAiUuxRlZLGeVr2xMVUFyqLUHJkYQ_6qoRbwDo9uqAICIbQI0f-lcDTVkl5RPdPtKwPhvL8ybq2_JzimrWRJQ_y-wEfSQ May 17 17:21:58.469052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 17 17:21:58.469052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 17 17:21:58.469052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 17 17:21:58.469052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 17 17:21:58.469052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 17 17:21:58.469052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 17 17:21:58.469052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 8e6d164baa864905bb74e05742739765 May 17 17:21:58.469052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-VolumesNegativeTest-1742642746 May 17 17:21:58.469052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Role: reader,member May 17 17:21:58.469052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Roles: reader,member May 17 17:21:58.470453 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8e6d164baa864905bb74e05742739765"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8e6d164baa864905bb74e05742739765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8e6d164baa864905bb74e05742739765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8e6d164baa864905bb74e05742739765", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:21:58.470453 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-VolumesNegativeTest-1742642746 May 17 17:21:58.470453 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 8e6d164baa864905bb74e05742739765 May 17 17:21:58.470453 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-VolumesNegativeTest-1742642746 May 17 17:21:58.470453 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User: tempest-VolumesNegativeTest-1742642746-project May 17 17:21:58.470453 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 17 17:21:58.470453 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 17 17:21:58.470453 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Id: 2e2195ba1ad3427a9a42ba3d73cda493 May 17 17:21:58.470453 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-VolumesNegativeTest-1742642746-project May 17 17:21:58.470453 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: method: May 17 17:21:58.470453 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: exception: Volume 77d2bee7-fc6e-4c96-9b70-d2bb06ba2dbe could not be found. May 17 17:21:58.470453 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: action_args: {'id': '77d2bee7-fc6e-4c96-9b70-d2bb06ba2dbe'} May 17 17:21:58.470453 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:21:58.471365 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:58.471365 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 17:21:58.471365 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 17:21:58.471365 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 17:21:58.471365 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 17:21:58.471365 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 17:21:58.471365 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 17:21:58.471365 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 17:21:58.471365 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 17:21:58.471365 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 17:21:58.471365 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 17:21:58.471365 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:21:58.471365 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:21:58.471365 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:21:58.471365 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:21:58.471365 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 77d2bee7-fc6e-4c96-9b70-d2bb06ba2dbe could not be found. (HTTP 404) (Request-ID: req-498437db-89c9-4874-a358-12e48dec00ec) May 17 17:21:58.471365 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:58.471365 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:21:58.471365 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:58.472837 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:58.472837 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 17 17:21:58.472837 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 17 17:21:58.472837 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 17:21:58.472837 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 17:21:58.472837 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 17:21:58.472837 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 17:21:58.472837 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 17:21:58.472837 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 17:21:58.472837 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 17:21:58.472837 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 17:21:58.472837 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 17:21:58.472837 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 17:21:58.472837 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 17:21:58.472837 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 17:21:58.472837 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 17:21:58.472837 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 17:21:58.472837 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 17:21:58.472837 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 17:21:58.475906 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:21:58.475906 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:21:58.475906 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:21:58.475906 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:21:58.475906 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 77d2bee7-fc6e-4c96-9b70-d2bb06ba2dbe could not be found. May 17 17:21:58.475906 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:58.475906 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:21:58.475906 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:58.475906 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:58.475906 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:21:58.475906 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:21:58.475906 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:21:58.475906 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:21:58.475906 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 17:21:58.475906 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 17:21:58.475906 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:21:58.475906 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:21:58.475906 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 17 17:21:58.475906 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:21:58.477288 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 77d2bee7-fc6e-4c96-9b70-d2bb06ba2dbe could not be found. May 17 17:21:58.477288 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:58.477288 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:21:58.477288 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:58.477288 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:21:58.477288 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:21:58.477288 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:21:58.477288 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:21:58.477288 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:21:58.477288 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 77d2bee7-fc6e-4c96-9b70-d2bb06ba2dbe could not be found. May 17 17:21:58.477288 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:21:58.477288 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-cf54343e-40f5-4823-8105-0270295c7c9a tempest-VolumesNegativeTest-1742642746 tempest-VolumesNegativeTest-1742642746-project] Returning 404 to user: Volume 77d2bee7-fc6e-4c96-9b70-d2bb06ba2dbe could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:21:58.477288 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-cf54343e-40f5-4823-8105-0270295c7c9a tempest-VolumesNegativeTest-1742642746 tempest-VolumesNegativeTest-1742642746-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/77d2bee7-fc6e-4c96-9b70-d2bb06ba2dbe" status: 404 len: 109 microversion: 2.1 time: 0.078725 May 17 17:21:58.481381 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 8/8] 10.222.0.88 () {58 vars in 1244 bytes} [Tue May 17 17:21:58 2022] GET /compute/v2.1/os-volumes/77d2bee7-fc6e-4c96-9b70-d2bb06ba2dbe => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:21:59.350933 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4f6178e7-b030-402a-9ea5-054a07cc42eb tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.357884 May 17 17:21:59.350933 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 1/9] 10.222.0.88 () {60 vars in 1154 bytes} [Tue May 17 17:21:55 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3361 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 17 17:21:59.381276 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8a19278c-2fa1-4d9a-8eef-151edc059c49 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] Calling method '.version_select at 0x7f73d1674af0>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:21:59.398415 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8a19278c-2fa1-4d9a-8eef-151edc059c49 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/84a1dfe1-0733-4456-966f-3d8366749ddd" status: 200 len: 345 microversion: 2.1 time: 0.101146 May 17 17:21:59.398415 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 9/10] 10.222.0.88 () {58 vars in 1244 bytes} [Tue May 17 17:21:59 2022] GET /compute/v2.1/os-volumes/84a1dfe1-0733-4456-966f-3d8366749ddd => generated 345 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:00.135535 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-91f5b17d-cf59-4751-a7ce-fc4e785b3807 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1751632028", "imageRef": "800c492c-ff69-4735-b2c9-a2dcaa20aa8d", "flavorRef": "452", "networks": [{"uuid": "ece6f23e-6266-46a3-af16-6b16d2cb90d9"}]}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:22:00.366541 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.network.neutron [None req-91f5b17d-cf59-4751-a7ce-fc4e785b3807 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] validate_networks() for [('ece6f23e-6266-46a3-af16-6b16d2cb90d9', None, None, None, None, None)] {{(pid=117611) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:22:00.409424 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d87c615b-4c54-4906-8bea-7768e3c56d35 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] Calling method '.version_select at 0x7f73d160e430>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:00.500833 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d87c615b-4c54-4906-8bea-7768e3c56d35 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/84a1dfe1-0733-4456-966f-3d8366749ddd" status: 200 len: 345 microversion: 2.1 time: 0.095222 May 17 17:22:00.506085 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 10/11] 10.222.0.88 () {58 vars in 1244 bytes} [Tue May 17 17:22:00 2022] GET /compute/v2.1/os-volumes/84a1dfe1-0733-4456-966f-3d8366749ddd => generated 345 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:01.519323 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-91f9cf49-80d1-459d-8aa1-6ce3207de5e0 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] Calling method '.version_select at 0x7f73d1621280>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:01.630575 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-91f9cf49-80d1-459d-8aa1-6ce3207de5e0 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/84a1dfe1-0733-4456-966f-3d8366749ddd" status: 200 len: 346 microversion: 2.1 time: 0.115628 May 17 17:22:01.630575 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 11/12] 10.222.0.88 () {58 vars in 1244 bytes} [Tue May 17 17:22:01 2022] GET /compute/v2.1/os-volumes/84a1dfe1-0733-4456-966f-3d8366749ddd => generated 346 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:01.638315 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2ae7139e-0e33-44d6-8f95-b1daecfcfe6e tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] Action: 'create', calling method: .version_select at 0x7f73d16218b0>, body: {"snapshot": {"volume_id": "84a1dfe1-0733-4456-966f-3d8366749ddd", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-415308316"}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:22:02.047032 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-91f5b17d-cf59-4751-a7ce-fc4e785b3807 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Flavor limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:22:02.047619 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-91f5b17d-cf59-4751-a7ce-fc4e785b3807 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Image limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:22:02.048090 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-91f5b17d-cf59-4751-a7ce-fc4e785b3807 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Flavor pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:22:02.048604 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-91f5b17d-cf59-4751-a7ce-fc4e785b3807 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Image pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:22:02.049077 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-91f5b17d-cf59-4751-a7ce-fc4e785b3807 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:22:02.094046 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-91f5b17d-cf59-4751-a7ce-fc4e785b3807 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:02.094497 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-91f5b17d-cf59-4751-a7ce-fc4e785b3807 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:02.095309 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-91f5b17d-cf59-4751-a7ce-fc4e785b3807 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:02.095766 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-91f5b17d-cf59-4751-a7ce-fc4e785b3807 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:02.175171 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-91f5b17d-cf59-4751-a7ce-fc4e785b3807 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Getting quotas for project 7e3052d0bf74405e8b7c964561163e6f. Resources: {'cores', 'ram', 'instances'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:22:02.189380 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-91f5b17d-cf59-4751-a7ce-fc4e785b3807 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Getting quotas for user 98dc9781e62d471eb8705ef299b5693a and project 7e3052d0bf74405e8b7c964561163e6f. Resources: {'cores', 'ram', 'instances'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:22:02.217177 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-91f5b17d-cf59-4751-a7ce-fc4e785b3807 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Going to run 1 instances... {{(pid=117611) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:22:02.220067 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-91f5b17d-cf59-4751-a7ce-fc4e785b3807 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='800c492c-ff69-4735-b2c9-a2dcaa20aa8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:22:02.374193 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2ae7139e-0e33-44d6-8f95-b1daecfcfe6e tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] 10.222.0.88 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.739422 May 17 17:22:02.381747 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 12/13] 10.222.0.88 () {60 vars in 1161 bytes} [Tue May 17 17:22:01 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:22:02.397442 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-03a8e0ba-b537-4e98-892f-1a9e6e7762d2 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] Calling method '.version_select at 0x7f73d1621790>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:02.525609 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-91f5b17d-cf59-4751-a7ce-fc4e785b3807 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.654940 May 17 17:22:02.539856 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 2/14] 10.222.0.88 () {60 vars in 1146 bytes} [Tue May 17 17:21:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:22:02.548352 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f5688fc0-26cc-439c-9d8e-eaa0565ececd tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:02.548352 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f5688fc0-26cc-439c-9d8e-eaa0565ececd tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:02.629098 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-03a8e0ba-b537-4e98-892f-1a9e6e7762d2 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/1e0bb819-e476-4700-8426-9ef8b55a3c76" status: 200 len: 286 microversion: 2.1 time: 0.240193 May 17 17:22:02.629805 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 13/15] 10.222.0.88 () {58 vars in 1250 bytes} [Tue May 17 17:22:02 2022] GET /compute/v2.1/os-snapshots/1e0bb819-e476-4700-8426-9ef8b55a3c76 => generated 286 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:02.639832 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3999c207-4328-42df-b949-37edcbdbc439 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] Calling method '.version_select at 0x7f73d1621040>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:02.818523 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3999c207-4328-42df-b949-37edcbdbc439 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.182681 May 17 17:22:02.819083 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 14/16] 10.222.0.88 () {58 vars in 1139 bytes} [Tue May 17 17:22:02 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:02.829183 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d784648b-a074-458d-b419-0dd35e9c77f5 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] Calling method '.version_select at 0x7f73d160e280>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:02.919596 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d784648b-a074-458d-b419-0dd35e9c77f5 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/1e0bb819-e476-4700-8426-9ef8b55a3c76" status: 200 len: 286 microversion: 2.1 time: 0.094094 May 17 17:22:02.920439 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 15/17] 10.222.0.88 () {58 vars in 1250 bytes} [Tue May 17 17:22:02 2022] GET /compute/v2.1/os-snapshots/1e0bb819-e476-4700-8426-9ef8b55a3c76 => generated 286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:03.126701 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f5688fc0-26cc-439c-9d8e-eaa0565ececd tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:03.155379 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f5688fc0-26cc-439c-9d8e-eaa0565ececd tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1215 microversion: 2.1 time: 0.606412 May 17 17:22:03.157215 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 3/18] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:02 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1215 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:03.932057 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b7b4a120-f897-46d9-a8a2-e006dbad3c96 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] Calling method '.version_select at 0x7f73d168b310>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:03.991335 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b7b4a120-f897-46d9-a8a2-e006dbad3c96 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/1e0bb819-e476-4700-8426-9ef8b55a3c76" status: 200 len: 286 microversion: 2.1 time: 0.063309 May 17 17:22:03.992465 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 4/19] 10.222.0.88 () {58 vars in 1250 bytes} [Tue May 17 17:22:03 2022] GET /compute/v2.1/os-snapshots/1e0bb819-e476-4700-8426-9ef8b55a3c76 => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:04.173584 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ac0b9175-fabd-468c-ad2e-316e86263a4f tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:04.175314 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ac0b9175-fabd-468c-ad2e-316e86263a4f tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:04.288058 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ac0b9175-fabd-468c-ad2e-316e86263a4f tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:04.298391 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ac0b9175-fabd-468c-ad2e-316e86263a4f tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1215 microversion: 2.1 time: 0.129383 May 17 17:22:04.299629 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 5/20] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:04 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1215 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:22:04.379080 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-48d7ede1-445d-4d1e-82d8-9df6584249d0 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Action: 'create', calling method: .version_select at 0x7f73d160edc0>, body: {"keypair": {"name": "tempest-keypair-549233228", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlcqEd3sewwW2KASFJwyuOd0VqBqpk3Gtd/R5M83ZOTEgyeNcli4DxqLHdW1lbxsaeW9/COwDQtpEF3dBlbmJoS7fiGQV5bEAfDG0jn0HNE5L+sRaFDv2cddQzNFUSjmA=="}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:22:04.490475 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-48d7ede1-445d-4d1e-82d8-9df6584249d0 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Getting quotas for project f2cc78ca5daa4d7d9df70c24b21bf8cf. Resources: {'key_pairs'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:22:04.502407 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-48d7ede1-445d-4d1e-82d8-9df6584249d0 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Getting quotas for user 19c023452db94dd0a2eea952ae762471 and project f2cc78ca5daa4d7d9df70c24b21bf8cf. Resources: {'key_pairs'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:22:04.708235 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-48d7ede1-445d-4d1e-82d8-9df6584249d0 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.843563 May 17 17:22:04.715443 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 16/21] 10.222.0.88 () {60 vars in 1158 bytes} [Tue May 17 17:22:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:05.005260 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-fc51c6e4-a0fb-4fa6-b390-e14813d34310 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] Calling method '.version_select at 0x7f73d0542e50>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:05.071899 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-fc51c6e4-a0fb-4fa6-b390-e14813d34310 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/1e0bb819-e476-4700-8426-9ef8b55a3c76" status: 200 len: 286 microversion: 2.1 time: 0.067103 May 17 17:22:05.071899 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 6/22] 10.222.0.88 () {58 vars in 1250 bytes} [Tue May 17 17:22:04 2022] GET /compute/v2.1/os-snapshots/1e0bb819-e476-4700-8426-9ef8b55a3c76 => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:05.316125 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-fa3db191-dee3-4dbe-b73e-d8353113cd82 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:05.316889 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-fa3db191-dee3-4dbe-b73e-d8353113cd82 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:05.527157 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-fa3db191-dee3-4dbe-b73e-d8353113cd82 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:05.549612 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-fa3db191-dee3-4dbe-b73e-d8353113cd82 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1215 microversion: 2.1 time: 0.237364 May 17 17:22:05.550932 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 17/23] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:05 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1215 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:06.080264 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c60114d0-dd6f-4e24-b047-717b4091d440 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] Calling method '.version_select at 0x7f73d0542430>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:06.146102 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c60114d0-dd6f-4e24-b047-717b4091d440 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/1e0bb819-e476-4700-8426-9ef8b55a3c76" status: 200 len: 287 microversion: 2.1 time: 0.068564 May 17 17:22:06.146102 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 7/24] 10.222.0.88 () {58 vars in 1250 bytes} [Tue May 17 17:22:06 2022] GET /compute/v2.1/os-snapshots/1e0bb819-e476-4700-8426-9ef8b55a3c76 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:06.156532 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-cef3d2a7-28aa-4d39-b855-ff5fcab79e17 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] Calling method '.version_select at 0x7f73d16d6f70>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:06.357020 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-cef3d2a7-28aa-4d39-b855-ff5fcab79e17 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] 10.222.0.88 "DELETE /compute/v2.1/os-snapshots/1e0bb819-e476-4700-8426-9ef8b55a3c76" status: 202 len: 0 microversion: 2.1 time: 0.200812 May 17 17:22:06.359745 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 18/25] 10.222.0.88 () {58 vars in 1253 bytes} [Tue May 17 17:22:06 2022] DELETE /compute/v2.1/os-snapshots/1e0bb819-e476-4700-8426-9ef8b55a3c76 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:22:06.371656 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-64774628-133b-4854-bda9-a0c3c7d31212 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] Calling method '.version_select at 0x7f73d168b430>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:06.433298 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-64774628-133b-4854-bda9-a0c3c7d31212 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/1e0bb819-e476-4700-8426-9ef8b55a3c76" status: 200 len: 286 microversion: 2.1 time: 0.069307 May 17 17:22:06.434393 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 8/26] 10.222.0.88 () {58 vars in 1250 bytes} [Tue May 17 17:22:06 2022] GET /compute/v2.1/os-snapshots/1e0bb819-e476-4700-8426-9ef8b55a3c76 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:06.569984 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-77236c6d-bbc4-4f7f-bf2e-90f3d987b572 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:06.569984 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-77236c6d-bbc4-4f7f-bf2e-90f3d987b572 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:06.595938 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-77236c6d-bbc4-4f7f-bf2e-90f3d987b572 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:06.599282 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-77236c6d-bbc4-4f7f-bf2e-90f3d987b572 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:06.617616 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-77236c6d-bbc4-4f7f-bf2e-90f3d987b572 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:06.619802 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-77236c6d-bbc4-4f7f-bf2e-90f3d987b572 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:07.105541 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-77236c6d-bbc4-4f7f-bf2e-90f3d987b572 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:07.146000 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-77236c6d-bbc4-4f7f-bf2e-90f3d987b572 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1211 microversion: 2.1 time: 0.581256 May 17 17:22:07.148338 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 19/27] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:06 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1211 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:07.448698 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d6daec81-7252-4fc5-b366-2e4d1fcf5f67 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] Calling method '.version_select at 0x7f73d168b310>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:07.505119 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-d6daec81-7252-4fc5-b366-2e4d1fcf5f67 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] HTTP exception thrown: Snapshot 1e0bb819-e476-4700-8426-9ef8b55a3c76 could not be found. May 17 17:22:07.511666 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d6daec81-7252-4fc5-b366-2e4d1fcf5f67 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] Request method failure captured: May 17 17:22:07.511666 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/os-snapshots/1e0bb819-e476-4700-8426-9ef8b55a3c76 HTTP/1.1 May 17 17:22:07.511666 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:22:07.511666 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:22:07.511666 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:22:07.511666 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:22:07.511666 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:22:07.511666 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:22:07.511666 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:22:07.511666 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:22:07.511666 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9mzM1vQHNMQtoRd02GcsRUBmDBQgi7AED5pfV08aceului0WBERBKB-4vqCWW9FUOrc1x4udb-gZUtpXD9SLPUopji_xHzcA2mFMyWy6dOhfVTpTshrRG6PMiIIkSJ70HAzyls6eaxJID3dFH9e9p4oDc04e2j-npYpwhjMr1JWbrs May 17 17:22:07.511666 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:22:07.511666 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:22:07.511666 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:22:07.511666 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:22:07.511666 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:22:07.511666 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:22:07.511666 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: f61bd80d8ebf453eb6c6dd85443f99f4 May 17 17:22:07.511666 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1129230038 May 17 17:22:07.511666 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:22:07.511666 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:22:07.515333 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f61bd80d8ebf453eb6c6dd85443f99f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f61bd80d8ebf453eb6c6dd85443f99f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f61bd80d8ebf453eb6c6dd85443f99f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f61bd80d8ebf453eb6c6dd85443f99f4", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:22:07.515333 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1129230038 May 17 17:22:07.515333 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: f61bd80d8ebf453eb6c6dd85443f99f4 May 17 17:22:07.515333 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1129230038 May 17 17:22:07.515333 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-VolumesSnapshotsTestJSON-1129230038-project May 17 17:22:07.515333 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:22:07.515333 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:22:07.515333 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 07c63e7f49724048845eb40b53112a7d May 17 17:22:07.515333 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1129230038-project May 17 17:22:07.515333 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: May 17 17:22:07.515333 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Snapshot 1e0bb819-e476-4700-8426-9ef8b55a3c76 could not be found. May 17 17:22:07.515333 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': '1e0bb819-e476-4700-8426-9ef8b55a3c76'} May 17 17:22:07.515333 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:22:07.516613 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:22:07.516613 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 17 17:22:07.516613 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 17 17:22:07.516613 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 17 17:22:07.516613 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 17 17:22:07.516613 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 17 17:22:07.516613 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 17 17:22:07.516613 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 17:22:07.516613 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 17:22:07.516613 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 17:22:07.516613 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 17:22:07.516613 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:22:07.516613 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:22:07.516613 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:22:07.516613 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:22:07.516613 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 1e0bb819-e476-4700-8426-9ef8b55a3c76 could not be found. (HTTP 404) (Request-ID: req-3dbc6f68-e695-4520-82df-695321d61a34) May 17 17:22:07.516613 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:22:07.516613 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:22:07.517574 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:22:07.517574 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:22:07.517574 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 17 17:22:07.517574 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 17 17:22:07.517574 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 17:22:07.517574 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 17:22:07.517574 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 17 17:22:07.517574 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 17 17:22:07.517574 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 17:22:07.517574 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 17:22:07.517574 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 17 17:22:07.517574 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 17 17:22:07.517574 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 17 17:22:07.517574 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 17 17:22:07.517574 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 17 17:22:07.517574 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 17 17:22:07.517574 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 17:22:07.517574 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 17:22:07.517574 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 17:22:07.518472 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 17:22:07.518472 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:22:07.518472 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:22:07.518472 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:22:07.518472 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:22:07.518472 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 1e0bb819-e476-4700-8426-9ef8b55a3c76 could not be found. May 17 17:22:07.518472 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:22:07.518472 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:22:07.518472 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:22:07.518472 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:22:07.518472 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:22:07.518472 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:22:07.518472 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:22:07.518472 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:22:07.518472 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 17:22:07.518472 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 17:22:07.518472 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:22:07.518472 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:22:07.518472 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 17 17:22:07.518472 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:22:07.520967 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 1e0bb819-e476-4700-8426-9ef8b55a3c76 could not be found. May 17 17:22:07.520967 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:22:07.520967 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:22:07.520967 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:22:07.520967 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:22:07.520967 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:22:07.520967 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:22:07.520967 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:22:07.520967 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:22:07.520967 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 1e0bb819-e476-4700-8426-9ef8b55a3c76 could not be found. May 17 17:22:07.520967 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:22:07.520967 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d6daec81-7252-4fc5-b366-2e4d1fcf5f67 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] Returning 404 to user: Snapshot 1e0bb819-e476-4700-8426-9ef8b55a3c76 could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:22:07.520967 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d6daec81-7252-4fc5-b366-2e4d1fcf5f67 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/1e0bb819-e476-4700-8426-9ef8b55a3c76" status: 404 len: 111 microversion: 2.1 time: 0.070337 May 17 17:22:07.522514 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 9/28] 10.222.0.88 () {58 vars in 1250 bytes} [Tue May 17 17:22:07 2022] GET /compute/v2.1/os-snapshots/1e0bb819-e476-4700-8426-9ef8b55a3c76 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:22:07.535743 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-362ccaa5-db5a-44c4-923e-40b54dee3ec0 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] Calling method '.version_select at 0x7f73d0ce1160>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:07.970271 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-362ccaa5-db5a-44c4-923e-40b54dee3ec0 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/84a1dfe1-0733-4456-966f-3d8366749ddd" status: 202 len: 0 microversion: 2.1 time: 0.450920 May 17 17:22:08.001827 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 20/29] 10.222.0.88 () {58 vars in 1247 bytes} [Tue May 17 17:22:07 2022] DELETE /compute/v2.1/os-volumes/84a1dfe1-0733-4456-966f-3d8366749ddd => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:22:08.024263 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-0c5f5f49-f3d9-4619-90a2-5ae647e36847 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] Calling method '.version_select at 0x7f73d1beae50>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:08.166533 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-da6ec852-7da8-4887-8181-95283d6a7ede tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:08.167700 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-da6ec852-7da8-4887-8181-95283d6a7ede tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:08.179667 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-da6ec852-7da8-4887-8181-95283d6a7ede tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:08.181783 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-0c5f5f49-f3d9-4619-90a2-5ae647e36847 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/84a1dfe1-0733-4456-966f-3d8366749ddd" status: 200 len: 345 microversion: 2.1 time: 0.193125 May 17 17:22:08.183352 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 10/30] 10.222.0.88 () {58 vars in 1244 bytes} [Tue May 17 17:22:07 2022] GET /compute/v2.1/os-volumes/84a1dfe1-0733-4456-966f-3d8366749ddd => generated 345 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:08.184345 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-da6ec852-7da8-4887-8181-95283d6a7ede tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:08.185802 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-da6ec852-7da8-4887-8181-95283d6a7ede tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:08.190653 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-da6ec852-7da8-4887-8181-95283d6a7ede tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:08.563609 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-da6ec852-7da8-4887-8181-95283d6a7ede tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:08.577270 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-da6ec852-7da8-4887-8181-95283d6a7ede tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1275 microversion: 2.1 time: 0.416132 May 17 17:22:08.577858 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 21/31] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:08 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1275 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:09.196703 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b841d2b2-1d9c-4845-97e2-d88afb6dc970 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] Calling method '.version_select at 0x7f73d0db4820>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:09.242163 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-b841d2b2-1d9c-4845-97e2-d88afb6dc970 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] HTTP exception thrown: Volume 84a1dfe1-0733-4456-966f-3d8366749ddd could not be found. May 17 17:22:09.245824 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b841d2b2-1d9c-4845-97e2-d88afb6dc970 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] Request method failure captured: May 17 17:22:09.245824 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/os-volumes/84a1dfe1-0733-4456-966f-3d8366749ddd HTTP/1.1 May 17 17:22:09.245824 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:22:09.245824 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:22:09.245824 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:22:09.245824 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:22:09.245824 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:22:09.245824 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:22:09.245824 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:22:09.245824 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:22:09.245824 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9mzM1vQHNMQtoRd02GcsRUBmDBQgi7AED5pfV08aceului0WBERBKB-4vqCWW9FUOrc1x4udb-gZUtpXD9SLPUopji_xHzcA2mFMyWy6dOhfVTpTshrRG6PMiIIkSJ70HAzyls6eaxJID3dFH9e9p4oDc04e2j-npYpwhjMr1JWbrs May 17 17:22:09.245824 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:22:09.245824 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:22:09.245824 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:22:09.245824 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:22:09.245824 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:22:09.245824 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:22:09.245824 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: f61bd80d8ebf453eb6c6dd85443f99f4 May 17 17:22:09.245824 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1129230038 May 17 17:22:09.245824 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:22:09.245824 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:22:09.246914 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f61bd80d8ebf453eb6c6dd85443f99f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f61bd80d8ebf453eb6c6dd85443f99f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f61bd80d8ebf453eb6c6dd85443f99f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f61bd80d8ebf453eb6c6dd85443f99f4", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:22:09.246914 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1129230038 May 17 17:22:09.246914 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: f61bd80d8ebf453eb6c6dd85443f99f4 May 17 17:22:09.246914 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1129230038 May 17 17:22:09.246914 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-VolumesSnapshotsTestJSON-1129230038-project May 17 17:22:09.246914 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:22:09.246914 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:22:09.246914 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 07c63e7f49724048845eb40b53112a7d May 17 17:22:09.246914 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1129230038-project May 17 17:22:09.246914 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: May 17 17:22:09.246914 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Volume 84a1dfe1-0733-4456-966f-3d8366749ddd could not be found. May 17 17:22:09.246914 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': '84a1dfe1-0733-4456-966f-3d8366749ddd'} May 17 17:22:09.246914 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:22:09.247556 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:22:09.247556 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 17:22:09.247556 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 17:22:09.247556 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 17:22:09.247556 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 17:22:09.247556 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 17:22:09.247556 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 17:22:09.247556 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 17:22:09.247556 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 17:22:09.247556 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 17:22:09.247556 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 17:22:09.247556 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:22:09.247556 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:22:09.247556 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:22:09.247556 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:22:09.247556 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 84a1dfe1-0733-4456-966f-3d8366749ddd could not be found. (HTTP 404) (Request-ID: req-84336724-be64-4c5f-ac67-288aad1eb2d4) May 17 17:22:09.247556 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:22:09.247556 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:22:09.247556 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:22:09.248451 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:22:09.248451 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 17 17:22:09.248451 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 17 17:22:09.248451 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 17:22:09.248451 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 17:22:09.248451 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 17:22:09.248451 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 17:22:09.248451 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 17:22:09.248451 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 17:22:09.248451 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 17:22:09.248451 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 17:22:09.248451 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 17:22:09.248451 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 17:22:09.248451 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 17:22:09.248451 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 17:22:09.248451 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 17:22:09.248451 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 17:22:09.248451 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 17:22:09.248451 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 17:22:09.249347 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:22:09.249347 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:22:09.249347 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:22:09.249347 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:22:09.249347 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 84a1dfe1-0733-4456-966f-3d8366749ddd could not be found. May 17 17:22:09.249347 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:22:09.249347 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:22:09.249347 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:22:09.249347 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:22:09.249347 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:22:09.249347 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:22:09.249347 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:22:09.249347 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:22:09.249347 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 17:22:09.249347 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 17:22:09.249347 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:22:09.249347 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:22:09.249347 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 17 17:22:09.249347 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:22:09.250729 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 84a1dfe1-0733-4456-966f-3d8366749ddd could not be found. May 17 17:22:09.250729 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:22:09.250729 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:22:09.250729 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:22:09.250729 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:22:09.250729 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:22:09.250729 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:22:09.250729 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:22:09.250729 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:22:09.250729 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 84a1dfe1-0733-4456-966f-3d8366749ddd could not be found. May 17 17:22:09.250729 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:22:09.260857 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b841d2b2-1d9c-4845-97e2-d88afb6dc970 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] Returning 404 to user: Volume 84a1dfe1-0733-4456-966f-3d8366749ddd could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:22:09.264430 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b841d2b2-1d9c-4845-97e2-d88afb6dc970 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/84a1dfe1-0733-4456-966f-3d8366749ddd" status: 404 len: 109 microversion: 2.1 time: 0.071311 May 17 17:22:09.266058 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 11/32] 10.222.0.88 () {58 vars in 1244 bytes} [Tue May 17 17:22:09 2022] GET /compute/v2.1/os-volumes/84a1dfe1-0733-4456-966f-3d8366749ddd => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:22:09.280849 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0fa5c81a-d1e5-4f31-9aa8-3791e3262f1a tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] Calling method '.version_select at 0x7f73d0cebd30>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:09.350334 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-0fa5c81a-d1e5-4f31-9aa8-3791e3262f1a tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] HTTP exception thrown: Volume 84a1dfe1-0733-4456-966f-3d8366749ddd could not be found. May 17 17:22:09.352809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0fa5c81a-d1e5-4f31-9aa8-3791e3262f1a tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] Request method failure captured: May 17 17:22:09.352809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: request: DELETE /compute/v2.1/os-volumes/84a1dfe1-0733-4456-966f-3d8366749ddd HTTP/1.1 May 17 17:22:09.352809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 17 17:22:09.352809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 17 17:22:09.352809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Connection: close May 17 17:22:09.352809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 17 17:22:09.352809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 17 17:22:09.352809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.88 May 17 17:22:09.352809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 17 17:22:09.352809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 17 17:22:09.352809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABig9mzM1vQHNMQtoRd02GcsRUBmDBQgi7AED5pfV08aceului0WBERBKB-4vqCWW9FUOrc1x4udb-gZUtpXD9SLPUopji_xHzcA2mFMyWy6dOhfVTpTshrRG6PMiIIkSJ70HAzyls6eaxJID3dFH9e9p4oDc04e2j-npYpwhjMr1JWbrs May 17 17:22:09.352809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 17 17:22:09.352809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 17 17:22:09.352809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 17 17:22:09.352809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 17 17:22:09.352809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 17 17:22:09.352809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 17 17:22:09.352809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Id: f61bd80d8ebf453eb6c6dd85443f99f4 May 17 17:22:09.352809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1129230038 May 17 17:22:09.352809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Role: reader,member May 17 17:22:09.352809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Roles: reader,member May 17 17:22:09.353864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f61bd80d8ebf453eb6c6dd85443f99f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f61bd80d8ebf453eb6c6dd85443f99f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f61bd80d8ebf453eb6c6dd85443f99f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f61bd80d8ebf453eb6c6dd85443f99f4", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:22:09.353864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1129230038 May 17 17:22:09.353864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: f61bd80d8ebf453eb6c6dd85443f99f4 May 17 17:22:09.353864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1129230038 May 17 17:22:09.353864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User: tempest-VolumesSnapshotsTestJSON-1129230038-project May 17 17:22:09.353864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 17 17:22:09.353864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 17 17:22:09.353864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Id: 07c63e7f49724048845eb40b53112a7d May 17 17:22:09.353864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1129230038-project May 17 17:22:09.353864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: method: May 17 17:22:09.353864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: exception: Volume 84a1dfe1-0733-4456-966f-3d8366749ddd could not be found. May 17 17:22:09.353864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: action_args: {'id': '84a1dfe1-0733-4456-966f-3d8366749ddd'} May 17 17:22:09.353864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:22:09.354485 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:22:09.354485 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 17:22:09.354485 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 17:22:09.354485 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 17:22:09.354485 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 17:22:09.354485 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 17:22:09.354485 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 17:22:09.354485 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 17:22:09.354485 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 17:22:09.354485 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 17:22:09.354485 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 17:22:09.354485 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:22:09.354485 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:22:09.354485 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:22:09.354485 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:22:09.354485 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 84a1dfe1-0733-4456-966f-3d8366749ddd could not be found. (HTTP 404) (Request-ID: req-79cd04b3-bbbb-402c-b052-23c5cf4b955d) May 17 17:22:09.354485 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:22:09.354485 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:22:09.354485 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:22:09.355396 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:22:09.355396 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 17 17:22:09.355396 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 17 17:22:09.355396 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 17:22:09.355396 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 17:22:09.355396 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 17:22:09.355396 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 17:22:09.355396 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 17:22:09.355396 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 17:22:09.355396 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 17:22:09.355396 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 17:22:09.355396 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 17:22:09.355396 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 17:22:09.355396 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 17:22:09.355396 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 17:22:09.355396 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 17:22:09.355396 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 17:22:09.355396 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 17:22:09.355396 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 17:22:09.356606 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:22:09.356606 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:22:09.356606 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:22:09.356606 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:22:09.356606 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 84a1dfe1-0733-4456-966f-3d8366749ddd could not be found. May 17 17:22:09.356606 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:22:09.356606 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:22:09.356606 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:22:09.356606 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:22:09.356606 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:22:09.356606 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:22:09.356606 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:22:09.356606 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:22:09.356606 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 17:22:09.356606 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 17:22:09.356606 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:22:09.356606 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:22:09.356606 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 17 17:22:09.356606 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:22:09.357484 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 84a1dfe1-0733-4456-966f-3d8366749ddd could not be found. May 17 17:22:09.357484 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:22:09.357484 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:22:09.357484 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:22:09.357484 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:22:09.357484 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:22:09.357484 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:22:09.357484 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:22:09.357484 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:22:09.357484 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 84a1dfe1-0733-4456-966f-3d8366749ddd could not be found. May 17 17:22:09.357484 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:22:09.359621 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0fa5c81a-d1e5-4f31-9aa8-3791e3262f1a tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] Returning 404 to user: Volume 84a1dfe1-0733-4456-966f-3d8366749ddd could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:22:09.360719 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0fa5c81a-d1e5-4f31-9aa8-3791e3262f1a tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/84a1dfe1-0733-4456-966f-3d8366749ddd" status: 404 len: 109 microversion: 2.1 time: 0.088368 May 17 17:22:09.361797 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 22/33] 10.222.0.88 () {58 vars in 1247 bytes} [Tue May 17 17:22:09 2022] DELETE /compute/v2.1/os-volumes/84a1dfe1-0733-4456-966f-3d8366749ddd => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:22:09.372093 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b53df259-2040-4262-9b95-0b62f78e8812 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] Calling method '.version_select at 0x7f73d053d5e0>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:09.430079 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-b53df259-2040-4262-9b95-0b62f78e8812 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] HTTP exception thrown: Volume 84a1dfe1-0733-4456-966f-3d8366749ddd could not be found. May 17 17:22:09.432256 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b53df259-2040-4262-9b95-0b62f78e8812 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] Request method failure captured: May 17 17:22:09.432256 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/os-volumes/84a1dfe1-0733-4456-966f-3d8366749ddd HTTP/1.1 May 17 17:22:09.432256 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:22:09.432256 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:22:09.432256 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:22:09.432256 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:22:09.432256 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:22:09.432256 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:22:09.432256 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:22:09.432256 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:22:09.432256 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9mzM1vQHNMQtoRd02GcsRUBmDBQgi7AED5pfV08aceului0WBERBKB-4vqCWW9FUOrc1x4udb-gZUtpXD9SLPUopji_xHzcA2mFMyWy6dOhfVTpTshrRG6PMiIIkSJ70HAzyls6eaxJID3dFH9e9p4oDc04e2j-npYpwhjMr1JWbrs May 17 17:22:09.432256 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:22:09.432256 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:22:09.432256 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:22:09.432256 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:22:09.432256 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:22:09.432256 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:22:09.432256 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: f61bd80d8ebf453eb6c6dd85443f99f4 May 17 17:22:09.432256 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1129230038 May 17 17:22:09.432256 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:22:09.432256 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:22:09.435966 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f61bd80d8ebf453eb6c6dd85443f99f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f61bd80d8ebf453eb6c6dd85443f99f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f61bd80d8ebf453eb6c6dd85443f99f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f61bd80d8ebf453eb6c6dd85443f99f4", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:22:09.435966 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1129230038 May 17 17:22:09.435966 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: f61bd80d8ebf453eb6c6dd85443f99f4 May 17 17:22:09.435966 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1129230038 May 17 17:22:09.435966 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-VolumesSnapshotsTestJSON-1129230038-project May 17 17:22:09.435966 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:22:09.435966 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:22:09.435966 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 07c63e7f49724048845eb40b53112a7d May 17 17:22:09.435966 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1129230038-project May 17 17:22:09.435966 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: May 17 17:22:09.435966 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Volume 84a1dfe1-0733-4456-966f-3d8366749ddd could not be found. May 17 17:22:09.435966 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': '84a1dfe1-0733-4456-966f-3d8366749ddd'} May 17 17:22:09.435966 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:22:09.436592 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:22:09.436592 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 17:22:09.436592 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 17:22:09.436592 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 17:22:09.436592 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 17:22:09.436592 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 17:22:09.436592 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 17:22:09.436592 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 17:22:09.436592 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 17:22:09.436592 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 17:22:09.436592 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 17:22:09.436592 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:22:09.436592 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:22:09.436592 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:22:09.436592 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:22:09.436592 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 84a1dfe1-0733-4456-966f-3d8366749ddd could not be found. (HTTP 404) (Request-ID: req-66e4d9d8-0601-4134-9e5f-33a367703842) May 17 17:22:09.436592 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:22:09.436592 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:22:09.436592 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:22:09.437539 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:22:09.437539 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 17 17:22:09.437539 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 17 17:22:09.437539 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 17:22:09.437539 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 17:22:09.437539 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 17:22:09.437539 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 17:22:09.437539 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 17:22:09.437539 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 17:22:09.437539 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 17:22:09.437539 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 17:22:09.437539 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 17:22:09.437539 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 17:22:09.437539 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 17:22:09.437539 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 17:22:09.437539 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 17:22:09.437539 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 17:22:09.437539 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 17:22:09.437539 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 17:22:09.438452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:22:09.438452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:22:09.438452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:22:09.438452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:22:09.438452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 84a1dfe1-0733-4456-966f-3d8366749ddd could not be found. May 17 17:22:09.438452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:22:09.438452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:22:09.438452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:22:09.438452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:22:09.438452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:22:09.438452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:22:09.438452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:22:09.438452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:22:09.438452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 17:22:09.438452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 17:22:09.438452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:22:09.438452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:22:09.438452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 17 17:22:09.438452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:22:09.439331 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 84a1dfe1-0733-4456-966f-3d8366749ddd could not be found. May 17 17:22:09.439331 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:22:09.439331 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:22:09.439331 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:22:09.439331 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:22:09.439331 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:22:09.439331 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:22:09.439331 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:22:09.439331 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:22:09.439331 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 84a1dfe1-0733-4456-966f-3d8366749ddd could not be found. May 17 17:22:09.439331 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:22:09.439331 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b53df259-2040-4262-9b95-0b62f78e8812 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] Returning 404 to user: Volume 84a1dfe1-0733-4456-966f-3d8366749ddd could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:22:09.439331 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b53df259-2040-4262-9b95-0b62f78e8812 tempest-VolumesSnapshotsTestJSON-1129230038 tempest-VolumesSnapshotsTestJSON-1129230038-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/84a1dfe1-0733-4456-966f-3d8366749ddd" status: 404 len: 109 microversion: 2.1 time: 0.068069 May 17 17:22:09.439331 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 12/34] 10.222.0.88 () {58 vars in 1244 bytes} [Tue May 17 17:22:09 2022] GET /compute/v2.1/os-volumes/84a1dfe1-0733-4456-966f-3d8366749ddd => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:22:09.594144 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f4a18325-543d-4e65-a96d-080009ccc7e5 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:09.594929 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f4a18325-543d-4e65-a96d-080009ccc7e5 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:09.604206 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f4a18325-543d-4e65-a96d-080009ccc7e5 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:09.604726 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f4a18325-543d-4e65-a96d-080009ccc7e5 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:09.606822 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f4a18325-543d-4e65-a96d-080009ccc7e5 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:09.606822 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f4a18325-543d-4e65-a96d-080009ccc7e5 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:10.032205 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f4a18325-543d-4e65-a96d-080009ccc7e5 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:10.047363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f4a18325-543d-4e65-a96d-080009ccc7e5 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1273 microversion: 2.1 time: 0.456981 May 17 17:22:10.048550 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 13/35] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:09 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1273 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:22:10.175495 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0dc72916-a29e-4c26-b678-f5425f036356 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Action: 'create', calling method: .version_select at 0x7f73d160e0d0>, body: {"keypair": {"name": "tempest-keypair-1417574624", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuXbbyRGXLp9fpvt148eGs0xvtFMzIkMyJsksG0eiLNWViUG7A61LTJmtzM4JI12ZTJhMrn6T+lL3iFuZ1XTedeBlrYolxFfkHC+N4YMFCuVbIuMbkEyQLNDAi1/z0bzg=="}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:22:10.218607 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-0dc72916-a29e-4c26-b678-f5425f036356 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Getting quotas for project 649dd5d80f4142289f94ccd21ab4d68f. Resources: {'key_pairs'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:22:10.233251 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-0dc72916-a29e-4c26-b678-f5425f036356 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Getting quotas for user 49df2bc670324cd088691b8d20fcedab and project 649dd5d80f4142289f94ccd21ab4d68f. Resources: {'key_pairs'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:22:10.330287 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0dc72916-a29e-4c26-b678-f5425f036356 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.774105 May 17 17:22:10.337465 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 23/36] 10.222.0.88 () {62 vars in 1199 bytes} [Tue May 17 17:22:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 776 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 17 17:22:11.065251 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-550ccc51-9029-486d-876e-3c6d19e300fe tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:11.082876 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-550ccc51-9029-486d-876e-3c6d19e300fe tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:11.089680 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-550ccc51-9029-486d-876e-3c6d19e300fe tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:11.090453 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-550ccc51-9029-486d-876e-3c6d19e300fe tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:11.091443 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-550ccc51-9029-486d-876e-3c6d19e300fe tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:11.097250 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-550ccc51-9029-486d-876e-3c6d19e300fe tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:11.599704 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1d66c0d1-16cb-4466-9aa4-a23e67a6ff5d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1165821444", "imageRef": "800c492c-ff69-4735-b2c9-a2dcaa20aa8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ef9b8b57-e7d6-4cd7-847a-e5b40362443c"}], "security_groups": [{"name": "tempest-securitygroup--1631365401"}], "key_name": "tempest-keypair-549233228", "user_data": "}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:22:12.516926 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-550ccc51-9029-486d-876e-3c6d19e300fe tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:12.520416 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-550ccc51-9029-486d-876e-3c6d19e300fe tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1315 microversion: 2.1 time: 1.456276 May 17 17:22:12.534127 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 14/37] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:11 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1315 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:12.810600 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8fe98c77-faca-46a3-8f32-988c4d4734d7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1014966640", "imageRef": "800c492c-ff69-4735-b2c9-a2dcaa20aa8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:22:12.922671 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.network.neutron [None req-8fe98c77-faca-46a3-8f32-988c4d4734d7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] validate_networks() for [('3d831360-285e-4277-a650-d6bcbf399d51', None, None, None, None, None)] {{(pid=117611) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:22:13.079719 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.network.neutron [None req-1d66c0d1-16cb-4466-9aa4-a23e67a6ff5d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] validate_networks() for [('ef9b8b57-e7d6-4cd7-847a-e5b40362443c', None, None, None, None, None)] {{(pid=117612) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:22:15.656986 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-8fe98c77-faca-46a3-8f32-988c4d4734d7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Flavor limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:22:15.658039 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-8fe98c77-faca-46a3-8f32-988c4d4734d7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Image limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:22:15.658639 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-8fe98c77-faca-46a3-8f32-988c4d4734d7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Flavor pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:22:15.659151 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-8fe98c77-faca-46a3-8f32-988c4d4734d7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Image pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:22:15.659826 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-8fe98c77-faca-46a3-8f32-988c4d4734d7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:22:15.687321 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8fe98c77-faca-46a3-8f32-988c4d4734d7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:15.687833 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8fe98c77-faca-46a3-8f32-988c4d4734d7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:15.688760 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8fe98c77-faca-46a3-8f32-988c4d4734d7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:15.689214 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8fe98c77-faca-46a3-8f32-988c4d4734d7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:15.740362 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-8fe98c77-faca-46a3-8f32-988c4d4734d7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Getting quotas for project d2b0be03d2fd4baf84d7d0b462392cba. Resources: {'cores', 'ram', 'instances'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:22:15.765164 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-8fe98c77-faca-46a3-8f32-988c4d4734d7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Getting quotas for user 8ebdfee8d3d64c2696e9c5695cebdba3 and project d2b0be03d2fd4baf84d7d0b462392cba. Resources: {'cores', 'ram', 'instances'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:22:15.812427 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8fe98c77-faca-46a3-8f32-988c4d4734d7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Going to run 1 instances... {{(pid=117611) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:22:15.815023 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8fe98c77-faca-46a3-8f32-988c4d4734d7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='800c492c-ff69-4735-b2c9-a2dcaa20aa8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:22:15.984367 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8fe98c77-faca-46a3-8f32-988c4d4734d7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.453551 May 17 17:22:15.993781 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 15/38] 10.222.0.88 () {60 vars in 1146 bytes} [Tue May 17 17:22:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 3466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:22:16.005080 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-94d73552-9747-4c81-8fd8-4b7aef01ebf0 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:16.006041 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-94d73552-9747-4c81-8fd8-4b7aef01ebf0 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:16.026992 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-94d73552-9747-4c81-8fd8-4b7aef01ebf0 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:16.026992 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-94d73552-9747-4c81-8fd8-4b7aef01ebf0 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:16.026992 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-94d73552-9747-4c81-8fd8-4b7aef01ebf0 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:16.026992 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-94d73552-9747-4c81-8fd8-4b7aef01ebf0 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:16.262832 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-1d66c0d1-16cb-4466-9aa4-a23e67a6ff5d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Flavor limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:22:16.264170 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-1d66c0d1-16cb-4466-9aa4-a23e67a6ff5d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Image limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:22:16.264891 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-1d66c0d1-16cb-4466-9aa4-a23e67a6ff5d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Flavor pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:22:16.265520 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-1d66c0d1-16cb-4466-9aa4-a23e67a6ff5d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Image pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:22:16.266196 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-1d66c0d1-16cb-4466-9aa4-a23e67a6ff5d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:22:16.307949 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1d66c0d1-16cb-4466-9aa4-a23e67a6ff5d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:16.309543 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1d66c0d1-16cb-4466-9aa4-a23e67a6ff5d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:16.314427 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1d66c0d1-16cb-4466-9aa4-a23e67a6ff5d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:16.317008 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1d66c0d1-16cb-4466-9aa4-a23e67a6ff5d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:16.420257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-1d66c0d1-16cb-4466-9aa4-a23e67a6ff5d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Getting quotas for project f2cc78ca5daa4d7d9df70c24b21bf8cf. Resources: {'cores', 'ram', 'instances'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:22:16.432324 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-1d66c0d1-16cb-4466-9aa4-a23e67a6ff5d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Getting quotas for user 19c023452db94dd0a2eea952ae762471 and project f2cc78ca5daa4d7d9df70c24b21bf8cf. Resources: {'cores', 'ram', 'instances'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:22:16.471361 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1d66c0d1-16cb-4466-9aa4-a23e67a6ff5d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Going to run 1 instances... {{(pid=117612) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:22:16.483259 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1d66c0d1-16cb-4466-9aa4-a23e67a6ff5d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='800c492c-ff69-4735-b2c9-a2dcaa20aa8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:22:16.761643 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-94d73552-9747-4c81-8fd8-4b7aef01ebf0 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:16.769425 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-94d73552-9747-4c81-8fd8-4b7aef01ebf0 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1315 microversion: 2.1 time: 0.774539 May 17 17:22:16.771199 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 16/39] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:15 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1315 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:16.782751 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-0e27d8f1-43f6-4db2-8c5d-6e64d95a4132 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:16.784920 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-0e27d8f1-43f6-4db2-8c5d-6e64d95a4132 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:16.865144 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1d66c0d1-16cb-4466-9aa4-a23e67a6ff5d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.271647 May 17 17:22:16.865908 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 24/40] 10.222.0.88 () {60 vars in 1146 bytes} [Tue May 17 17:22:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 5273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:22:16.876766 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f214f5a9-c757-4472-be46-337708d809de tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:16.891980 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f214f5a9-c757-4472-be46-337708d809de tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:16.948861 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-0e27d8f1-43f6-4db2-8c5d-6e64d95a4132 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:16.959270 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-0e27d8f1-43f6-4db2-8c5d-6e64d95a4132 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1222 microversion: 2.1 time: 0.186009 May 17 17:22:16.959896 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 17/41] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:16 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1222 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:17.002989 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ac22979f-a6f3-4d08-9d1a-c21927a5e1eb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1327125619", "imageRef": "800c492c-ff69-4735-b2c9-a2dcaa20aa8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a6597032-505a-40f2-9431-0cbb683c79c9"}], "security_groups": [{"name": "tempest-securitygroup--57726146"}], "key_name": "tempest-keypair-1417574624", "user_data": "}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:22:17.032222 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f214f5a9-c757-4472-be46-337708d809de tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:17.042323 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f214f5a9-c757-4472-be46-337708d809de tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1237 microversion: 2.1 time: 0.169624 May 17 17:22:17.042909 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 25/42] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:16 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1237 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:22:17.220509 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.network.neutron [None req-ac22979f-a6f3-4d08-9d1a-c21927a5e1eb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] validate_networks() for [('a6597032-505a-40f2-9431-0cbb683c79c9', None, None, None, None, None)] {{(pid=117611) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:22:17.768503 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-4357b683-1ee3-4b02-bff3-9fedc179fb44 req-85d35d59-c39a-4564-88ac-9b586c39c7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "086aec45-2c47-4b06-9fc9-a19c44a3673a", "tag": "cd951b9f-179e-4c54-9050-7b2c81ed2b23"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:22:17.805841 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-4357b683-1ee3-4b02-bff3-9fedc179fb44 req-85d35d59-c39a-4564-88ac-9b586c39c7e1 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:17.806521 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-4357b683-1ee3-4b02-bff3-9fedc179fb44 req-85d35d59-c39a-4564-88ac-9b586c39c7e1 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:17.837525 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-4357b683-1ee3-4b02-bff3-9fedc179fb44 req-85d35d59-c39a-4564-88ac-9b586c39c7e1 service nova] Creating event network-changed:cd951b9f-179e-4c54-9050-7b2c81ed2b23 for instance 086aec45-2c47-4b06-9fc9-a19c44a3673a on hv-cinder-84214 May 17 17:22:17.840403 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-4357b683-1ee3-4b02-bff3-9fedc179fb44 req-85d35d59-c39a-4564-88ac-9b586c39c7e1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117612) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 17 17:22:17.842412 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-25644520-e3bf-41ea-998b-192ea4acb555 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:17.842976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-25644520-e3bf-41ea-998b-192ea4acb555 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:17.843976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-25644520-e3bf-41ea-998b-192ea4acb555 None None] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:17.844519 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-25644520-e3bf-41ea-998b-192ea4acb555 None None] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:17.854762 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.compute.rpcapi [None req-25644520-e3bf-41ea-998b-192ea4acb555 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 17 17:22:17.858178 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-25644520-e3bf-41ea-998b-192ea4acb555 None None] Releasing lock "compute-rpcapi-router" {{(pid=117612) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 17 17:22:17.872313 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-25644520-e3bf-41ea-998b-192ea4acb555 None None] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.609360 May 17 17:22:17.873422 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 26/43] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:17.879007 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-723ab5ae-45c8-4b2c-9292-b552b5b0fa57 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1559369870", "imageRef": "800c492c-ff69-4735-b2c9-a2dcaa20aa8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:22:17.981390 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.network.neutron [None req-723ab5ae-45c8-4b2c-9292-b552b5b0fa57 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] validate_networks() for [('3d831360-285e-4277-a650-d6bcbf399d51', None, None, None, None, None)] {{(pid=117612) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:22:18.195331 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-ac22979f-a6f3-4d08-9d1a-c21927a5e1eb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Flavor limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:22:18.195967 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-ac22979f-a6f3-4d08-9d1a-c21927a5e1eb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Image limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:22:18.196586 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-ac22979f-a6f3-4d08-9d1a-c21927a5e1eb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Flavor pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:22:18.197159 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-ac22979f-a6f3-4d08-9d1a-c21927a5e1eb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Image pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:22:18.197682 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-ac22979f-a6f3-4d08-9d1a-c21927a5e1eb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:22:18.237066 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ac22979f-a6f3-4d08-9d1a-c21927a5e1eb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:18.245599 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ac22979f-a6f3-4d08-9d1a-c21927a5e1eb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:18.245599 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ac22979f-a6f3-4d08-9d1a-c21927a5e1eb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:18.245599 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ac22979f-a6f3-4d08-9d1a-c21927a5e1eb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:18.330532 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-ac22979f-a6f3-4d08-9d1a-c21927a5e1eb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Getting quotas for project 649dd5d80f4142289f94ccd21ab4d68f. Resources: {'cores', 'ram', 'instances'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:22:18.338225 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-ac22979f-a6f3-4d08-9d1a-c21927a5e1eb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Getting quotas for user 49df2bc670324cd088691b8d20fcedab and project 649dd5d80f4142289f94ccd21ab4d68f. Resources: {'cores', 'ram', 'instances'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:22:18.351105 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ac22979f-a6f3-4d08-9d1a-c21927a5e1eb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Going to run 1 instances... {{(pid=117611) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:22:18.353934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ac22979f-a6f3-4d08-9d1a-c21927a5e1eb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='800c492c-ff69-4735-b2c9-a2dcaa20aa8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:22:18.585940 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ac22979f-a6f3-4d08-9d1a-c21927a5e1eb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.619096 May 17 17:22:18.587680 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 18/44] 10.222.0.88 () {62 vars in 1187 bytes} [Tue May 17 17:22:16 2022] POST /compute/v2.1/servers => generated 400 bytes in 1627 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 17 17:22:18.593194 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-9f206a4f-eba9-4588-8ff8-b8395c2c5c97 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:18.594205 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-9f206a4f-eba9-4588-8ff8-b8395c2c5c97 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:18.601659 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9f206a4f-eba9-4588-8ff8-b8395c2c5c97 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:18.603213 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9f206a4f-eba9-4588-8ff8-b8395c2c5c97 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:18.604278 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9f206a4f-eba9-4588-8ff8-b8395c2c5c97 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:18.604941 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9f206a4f-eba9-4588-8ff8-b8395c2c5c97 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:19.014814 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-723ab5ae-45c8-4b2c-9292-b552b5b0fa57 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Flavor limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:22:19.015396 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-723ab5ae-45c8-4b2c-9292-b552b5b0fa57 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Image limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:22:19.015727 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-723ab5ae-45c8-4b2c-9292-b552b5b0fa57 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Flavor pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:22:19.016138 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-723ab5ae-45c8-4b2c-9292-b552b5b0fa57 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Image pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:22:19.016549 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-723ab5ae-45c8-4b2c-9292-b552b5b0fa57 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:22:19.036036 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-723ab5ae-45c8-4b2c-9292-b552b5b0fa57 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:19.040168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-723ab5ae-45c8-4b2c-9292-b552b5b0fa57 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:19.041368 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-723ab5ae-45c8-4b2c-9292-b552b5b0fa57 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:19.041962 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-723ab5ae-45c8-4b2c-9292-b552b5b0fa57 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:19.087472 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-723ab5ae-45c8-4b2c-9292-b552b5b0fa57 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Getting quotas for project d2b0be03d2fd4baf84d7d0b462392cba. Resources: {'cores', 'ram', 'instances'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:22:19.119950 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-723ab5ae-45c8-4b2c-9292-b552b5b0fa57 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Getting quotas for user 8ebdfee8d3d64c2696e9c5695cebdba3 and project d2b0be03d2fd4baf84d7d0b462392cba. Resources: {'cores', 'ram', 'instances'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:22:19.162902 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-723ab5ae-45c8-4b2c-9292-b552b5b0fa57 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Going to run 1 instances... {{(pid=117612) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:22:19.169725 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-723ab5ae-45c8-4b2c-9292-b552b5b0fa57 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='800c492c-ff69-4735-b2c9-a2dcaa20aa8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:22:19.376572 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-723ab5ae-45c8-4b2c-9292-b552b5b0fa57 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.502067 May 17 17:22:19.377315 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-9f206a4f-eba9-4588-8ff8-b8395c2c5c97 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:19.377970 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 27/45] 10.222.0.88 () {60 vars in 1146 bytes} [Tue May 17 17:22:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 1504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:22:19.382835 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-00cc483a-e5c0-4bcd-a2ac-22f3eac870bb tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:19.388471 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-00cc483a-e5c0-4bcd-a2ac-22f3eac870bb tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:19.394202 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-9f206a4f-eba9-4588-8ff8-b8395c2c5c97 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1315 microversion: 2.1 time: 0.800603 May 17 17:22:19.394202 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 19/46] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:18 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1315 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:19.405340 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-00cc483a-e5c0-4bcd-a2ac-22f3eac870bb tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:19.406036 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-00cc483a-e5c0-4bcd-a2ac-22f3eac870bb tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:19.406660 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f80cd2fd-03c9-4014-b8ee-7edf0d15f8a0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:19.407294 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f80cd2fd-03c9-4014-b8ee-7edf0d15f8a0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:19.407672 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-00cc483a-e5c0-4bcd-a2ac-22f3eac870bb tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:19.408396 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-00cc483a-e5c0-4bcd-a2ac-22f3eac870bb tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:19.552417 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-00cc483a-e5c0-4bcd-a2ac-22f3eac870bb tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:19.564325 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-00cc483a-e5c0-4bcd-a2ac-22f3eac870bb tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1233 microversion: 2.1 time: 0.182924 May 17 17:22:19.565848 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 28/47] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:19 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1233 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:19.680808 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f80cd2fd-03c9-4014-b8ee-7edf0d15f8a0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:19.694629 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f80cd2fd-03c9-4014-b8ee-7edf0d15f8a0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:19.700981 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f80cd2fd-03c9-4014-b8ee-7edf0d15f8a0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:19.700981 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f80cd2fd-03c9-4014-b8ee-7edf0d15f8a0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1282 microversion: 2.20 time: 0.303847 May 17 17:22:19.707921 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 20/48] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:19 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1282 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:22:19.714601 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8ef90f07-f5e2-45f0-aef5-d18964fd463a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:19.715390 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8ef90f07-f5e2-45f0-aef5-d18964fd463a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:19.914383 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8ef90f07-f5e2-45f0-aef5-d18964fd463a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:19.923859 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8ef90f07-f5e2-45f0-aef5-d18964fd463a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1222 microversion: 2.1 time: 0.214477 May 17 17:22:19.933739 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 21/49] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:19 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1222 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:19.986916 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-87c6e4ac-8ecb-447a-9097-a3f140e8b759 tempest-VolumesGetTestJSON-798856330 tempest-VolumesGetTestJSON-798856330-project] Action: 'create', calling method: .version_select at 0x7f73d03c6e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2007691755", "metadata": {"Type": "work"}}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:22:20.422792 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a6b3d315-f9d3-4e71-804e-64f1824f489a tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:20.429478 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a6b3d315-f9d3-4e71-804e-64f1824f489a tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:20.464189 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a6b3d315-f9d3-4e71-804e-64f1824f489a tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:20.464940 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a6b3d315-f9d3-4e71-804e-64f1824f489a tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:20.465976 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a6b3d315-f9d3-4e71-804e-64f1824f489a tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:20.466605 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a6b3d315-f9d3-4e71-804e-64f1824f489a tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:20.771748 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a6b3d315-f9d3-4e71-804e-64f1824f489a tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:20.784720 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a6b3d315-f9d3-4e71-804e-64f1824f489a tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1315 microversion: 2.1 time: 0.377537 May 17 17:22:20.796490 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 22/50] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:20 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:22:20.801099 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-044b41cd-7c6d-46b6-836f-f13b12251a0f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:20.801728 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-044b41cd-7c6d-46b6-836f-f13b12251a0f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:20.822426 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-044b41cd-7c6d-46b6-836f-f13b12251a0f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:20.823334 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-044b41cd-7c6d-46b6-836f-f13b12251a0f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:20.824940 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-044b41cd-7c6d-46b6-836f-f13b12251a0f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:20.825631 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-044b41cd-7c6d-46b6-836f-f13b12251a0f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:20.904016 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-044b41cd-7c6d-46b6-836f-f13b12251a0f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:20.914263 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-044b41cd-7c6d-46b6-836f-f13b12251a0f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1289 microversion: 2.1 time: 0.117272 May 17 17:22:20.920459 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 23/51] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:20 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1289 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:20.920459 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c8d60a5f-c058-4091-90a0-3367d3030bd2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:20.920632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c8d60a5f-c058-4091-90a0-3367d3030bd2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:20.936357 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c8d60a5f-c058-4091-90a0-3367d3030bd2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:20.937152 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c8d60a5f-c058-4091-90a0-3367d3030bd2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:20.940404 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c8d60a5f-c058-4091-90a0-3367d3030bd2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:20.942742 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c8d60a5f-c058-4091-90a0-3367d3030bd2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:21.107484 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-87c6e4ac-8ecb-447a-9097-a3f140e8b759 tempest-VolumesGetTestJSON-798856330 tempest-VolumesGetTestJSON-798856330-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.539114 May 17 17:22:21.115252 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 29/52] 10.222.0.88 () {60 vars in 1155 bytes} [Tue May 17 17:22:19 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1548 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 17 17:22:21.120888 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c28ec8e4-c2d0-4f6e-9770-f17784803f10 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:21.122816 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c28ec8e4-c2d0-4f6e-9770-f17784803f10 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:21.130254 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c8d60a5f-c058-4091-90a0-3367d3030bd2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:21.140333 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c8d60a5f-c058-4091-90a0-3367d3030bd2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:21.141848 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c8d60a5f-c058-4091-90a0-3367d3030bd2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:21.142970 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c8d60a5f-c058-4091-90a0-3367d3030bd2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1286 microversion: 2.20 time: 0.227069 May 17 17:22:21.165055 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c28ec8e4-c2d0-4f6e-9770-f17784803f10 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:21.165515 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c28ec8e4-c2d0-4f6e-9770-f17784803f10 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:21.171891 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c28ec8e4-c2d0-4f6e-9770-f17784803f10 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:21.171891 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c28ec8e4-c2d0-4f6e-9770-f17784803f10 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:21.172398 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 24/53] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:20 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1286 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:22:21.177200 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c22bbd2f-e935-4fca-b1b5-7be4598899a7 tempest-VolumesGetTestJSON-798856330 tempest-VolumesGetTestJSON-798856330-project] Calling method '.version_select at 0x7f73d0478040>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:21.303096 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c22bbd2f-e935-4fca-b1b5-7be4598899a7 tempest-VolumesGetTestJSON-798856330 tempest-VolumesGetTestJSON-798856330-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/6d85a2fd-d75d-4965-b5b6-0cb08e16ca7b" status: 200 len: 353 microversion: 2.1 time: 0.132751 May 17 17:22:21.308508 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 25/54] 10.222.0.88 () {58 vars in 1244 bytes} [Tue May 17 17:22:21 2022] GET /compute/v2.1/os-volumes/6d85a2fd-d75d-4965-b5b6-0cb08e16ca7b => generated 353 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:21.341361 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c28ec8e4-c2d0-4f6e-9770-f17784803f10 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:21.351064 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c28ec8e4-c2d0-4f6e-9770-f17784803f10 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1226 microversion: 2.1 time: 0.234611 May 17 17:22:21.351666 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 30/55] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:21 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1226 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:21.802372 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-34ee1645-cff2-45f5-8a6d-6d4ae06c9b3e tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:21.828264 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-34ee1645-cff2-45f5-8a6d-6d4ae06c9b3e tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:21.828264 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-34ee1645-cff2-45f5-8a6d-6d4ae06c9b3e tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:21.828264 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-34ee1645-cff2-45f5-8a6d-6d4ae06c9b3e tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:21.828264 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-34ee1645-cff2-45f5-8a6d-6d4ae06c9b3e tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:21.829076 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-34ee1645-cff2-45f5-8a6d-6d4ae06c9b3e tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:21.959923 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5f05d505-54f3-43c6-8f36-5c2e12ec8f82 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:21.960891 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5f05d505-54f3-43c6-8f36-5c2e12ec8f82 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:21.974508 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5f05d505-54f3-43c6-8f36-5c2e12ec8f82 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:21.975314 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5f05d505-54f3-43c6-8f36-5c2e12ec8f82 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:21.976606 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5f05d505-54f3-43c6-8f36-5c2e12ec8f82 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:21.977262 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5f05d505-54f3-43c6-8f36-5c2e12ec8f82 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:22.008166 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-34ee1645-cff2-45f5-8a6d-6d4ae06c9b3e tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:22.017514 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-34ee1645-cff2-45f5-8a6d-6d4ae06c9b3e tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1315 microversion: 2.1 time: 0.218852 May 17 17:22:22.018118 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 26/56] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:21 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:22.058989 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5f05d505-54f3-43c6-8f36-5c2e12ec8f82 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:22.066935 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5f05d505-54f3-43c6-8f36-5c2e12ec8f82 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1297 microversion: 2.1 time: 0.133443 May 17 17:22:22.071546 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 31/57] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:21 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1297 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:22.187211 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4085440a-814d-41d2-917e-7b5c878bee6a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:22.187858 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4085440a-814d-41d2-917e-7b5c878bee6a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:22.198383 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4085440a-814d-41d2-917e-7b5c878bee6a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:22.198383 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4085440a-814d-41d2-917e-7b5c878bee6a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:22.198383 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4085440a-814d-41d2-917e-7b5c878bee6a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:22.198383 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4085440a-814d-41d2-917e-7b5c878bee6a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:22.262984 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4085440a-814d-41d2-917e-7b5c878bee6a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:22.271411 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4085440a-814d-41d2-917e-7b5c878bee6a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:22.272995 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4085440a-814d-41d2-917e-7b5c878bee6a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:22.274096 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4085440a-814d-41d2-917e-7b5c878bee6a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1286 microversion: 2.20 time: 0.090788 May 17 17:22:22.274827 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 27/58] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:22 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:22:22.317210 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3c3c4bec-5d7c-4e44-945e-7a75affaae53 tempest-VolumesGetTestJSON-798856330 tempest-VolumesGetTestJSON-798856330-project] Calling method '.version_select at 0x7f73d03fc790>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:22.369991 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3c3c4bec-5d7c-4e44-945e-7a75affaae53 tempest-VolumesGetTestJSON-798856330 tempest-VolumesGetTestJSON-798856330-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/6d85a2fd-d75d-4965-b5b6-0cb08e16ca7b" status: 200 len: 353 microversion: 2.1 time: 0.051602 May 17 17:22:22.369991 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 32/59] 10.222.0.88 () {58 vars in 1244 bytes} [Tue May 17 17:22:22 2022] GET /compute/v2.1/os-volumes/6d85a2fd-d75d-4965-b5b6-0cb08e16ca7b => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:22.370377 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4d4ddcfe-08e7-49f4-9442-b69f4f52845f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:22.371204 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4d4ddcfe-08e7-49f4-9442-b69f4f52845f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:22.380033 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4d4ddcfe-08e7-49f4-9442-b69f4f52845f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:22.380485 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4d4ddcfe-08e7-49f4-9442-b69f4f52845f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:22.381265 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4d4ddcfe-08e7-49f4-9442-b69f4f52845f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:22.381755 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4d4ddcfe-08e7-49f4-9442-b69f4f52845f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:22.445416 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4d4ddcfe-08e7-49f4-9442-b69f4f52845f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:22.453162 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4d4ddcfe-08e7-49f4-9442-b69f4f52845f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1226 microversion: 2.1 time: 0.087683 May 17 17:22:22.453737 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 28/60] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:22 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:23.035571 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6b5e508a-941d-4493-a169-05ca3c96877e tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:23.036197 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6b5e508a-941d-4493-a169-05ca3c96877e tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:23.044319 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6b5e508a-941d-4493-a169-05ca3c96877e tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:23.045453 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6b5e508a-941d-4493-a169-05ca3c96877e tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:23.046237 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6b5e508a-941d-4493-a169-05ca3c96877e tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:23.046678 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6b5e508a-941d-4493-a169-05ca3c96877e tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:23.084854 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d41a080a-03bf-4b57-9df2-8e70fb8a84e7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:23.085690 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d41a080a-03bf-4b57-9df2-8e70fb8a84e7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:23.091943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d41a080a-03bf-4b57-9df2-8e70fb8a84e7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:23.092514 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d41a080a-03bf-4b57-9df2-8e70fb8a84e7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:23.093409 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d41a080a-03bf-4b57-9df2-8e70fb8a84e7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:23.094023 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d41a080a-03bf-4b57-9df2-8e70fb8a84e7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:23.176209 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d41a080a-03bf-4b57-9df2-8e70fb8a84e7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:23.184602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d41a080a-03bf-4b57-9df2-8e70fb8a84e7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1297 microversion: 2.1 time: 0.103454 May 17 17:22:23.186107 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 29/61] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:23 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1297 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:23.238421 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6b5e508a-941d-4493-a169-05ca3c96877e tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:23.245684 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6b5e508a-941d-4493-a169-05ca3c96877e tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1315 microversion: 2.1 time: 0.215130 May 17 17:22:23.246306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 33/62] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:23 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:23.292897 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-bf8453c4-84dc-404f-a020-fc602dc45020 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:23.293637 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-bf8453c4-84dc-404f-a020-fc602dc45020 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:23.299680 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bf8453c4-84dc-404f-a020-fc602dc45020 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:23.300373 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bf8453c4-84dc-404f-a020-fc602dc45020 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:23.301221 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bf8453c4-84dc-404f-a020-fc602dc45020 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:23.301729 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bf8453c4-84dc-404f-a020-fc602dc45020 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:23.372327 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-bf8453c4-84dc-404f-a020-fc602dc45020 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:23.374388 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-bf8453c4-84dc-404f-a020-fc602dc45020 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:23.376232 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-bf8453c4-84dc-404f-a020-fc602dc45020 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:23.377421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-bf8453c4-84dc-404f-a020-fc602dc45020 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1278 microversion: 2.20 time: 0.088585 May 17 17:22:23.378151 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 30/63] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:23 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1278 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:22:23.394020 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c688183e-3e21-4d61-807e-e8cf6b384d57 tempest-VolumesGetTestJSON-798856330 tempest-VolumesGetTestJSON-798856330-project] Calling method '.version_select at 0x7f73d0c18c10>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:23.448588 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c688183e-3e21-4d61-807e-e8cf6b384d57 tempest-VolumesGetTestJSON-798856330 tempest-VolumesGetTestJSON-798856330-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/6d85a2fd-d75d-4965-b5b6-0cb08e16ca7b" status: 200 len: 353 microversion: 2.1 time: 0.070928 May 17 17:22:23.449335 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 34/64] 10.222.0.88 () {58 vars in 1244 bytes} [Tue May 17 17:22:23 2022] GET /compute/v2.1/os-volumes/6d85a2fd-d75d-4965-b5b6-0cb08e16ca7b => generated 353 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:22:23.469476 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-671c695f-d31d-44c0-9daf-c7ca2979ef3f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:23.473729 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-671c695f-d31d-44c0-9daf-c7ca2979ef3f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:23.476389 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-671c695f-d31d-44c0-9daf-c7ca2979ef3f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:23.476833 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-671c695f-d31d-44c0-9daf-c7ca2979ef3f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:23.477593 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-671c695f-d31d-44c0-9daf-c7ca2979ef3f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:23.478017 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-671c695f-d31d-44c0-9daf-c7ca2979ef3f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:23.541710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-671c695f-d31d-44c0-9daf-c7ca2979ef3f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:23.549875 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-671c695f-d31d-44c0-9daf-c7ca2979ef3f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1226 microversion: 2.1 time: 0.084188 May 17 17:22:23.550467 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 31/65] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:23 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:24.202390 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2f4cdfef-7ccf-4f44-92a8-564814113743 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:24.203052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2f4cdfef-7ccf-4f44-92a8-564814113743 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:24.213343 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2f4cdfef-7ccf-4f44-92a8-564814113743 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:24.213899 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2f4cdfef-7ccf-4f44-92a8-564814113743 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:24.214769 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2f4cdfef-7ccf-4f44-92a8-564814113743 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:24.215378 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2f4cdfef-7ccf-4f44-92a8-564814113743 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:24.262311 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-60f199e6-777c-41a3-9ae5-ae74801edb64 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:24.263146 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-60f199e6-777c-41a3-9ae5-ae74801edb64 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:24.269449 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-60f199e6-777c-41a3-9ae5-ae74801edb64 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:24.269984 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-60f199e6-777c-41a3-9ae5-ae74801edb64 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:24.270835 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-60f199e6-777c-41a3-9ae5-ae74801edb64 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:24.271393 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-60f199e6-777c-41a3-9ae5-ae74801edb64 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:24.281373 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2f4cdfef-7ccf-4f44-92a8-564814113743 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:24.291195 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2f4cdfef-7ccf-4f44-92a8-564814113743 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1297 microversion: 2.1 time: 0.092496 May 17 17:22:24.307047 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 35/66] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:24 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1297 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:24.397160 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f981c2e1-ceba-456a-9328-5f2db4f14767 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:24.406254 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f981c2e1-ceba-456a-9328-5f2db4f14767 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:24.419829 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f981c2e1-ceba-456a-9328-5f2db4f14767 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:24.419829 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f981c2e1-ceba-456a-9328-5f2db4f14767 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:24.419829 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f981c2e1-ceba-456a-9328-5f2db4f14767 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:24.420195 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f981c2e1-ceba-456a-9328-5f2db4f14767 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:24.515231 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-60f199e6-777c-41a3-9ae5-ae74801edb64 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:24.530121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-60f199e6-777c-41a3-9ae5-ae74801edb64 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1315 microversion: 2.1 time: 0.265758 May 17 17:22:24.530121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 32/67] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:24 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:22:24.532736 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f981c2e1-ceba-456a-9328-5f2db4f14767 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:24.536034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-94184966-46ad-4708-b34a-34a0ecdfacac tempest-VolumesGetTestJSON-798856330 tempest-VolumesGetTestJSON-798856330-project] Calling method '.version_select at 0x7f73d0403a60>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:24.541070 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f981c2e1-ceba-456a-9328-5f2db4f14767 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:24.542976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f981c2e1-ceba-456a-9328-5f2db4f14767 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:24.547811 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f981c2e1-ceba-456a-9328-5f2db4f14767 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1278 microversion: 2.20 time: 0.155225 May 17 17:22:24.550024 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 36/68] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:24 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:22:24.578402 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-abf69270-75ae-448f-ad73-fb2a7726ee9f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:24.581552 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-abf69270-75ae-448f-ad73-fb2a7726ee9f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:24.587699 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-abf69270-75ae-448f-ad73-fb2a7726ee9f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:24.588570 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-abf69270-75ae-448f-ad73-fb2a7726ee9f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:24.589535 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-abf69270-75ae-448f-ad73-fb2a7726ee9f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:24.590128 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-abf69270-75ae-448f-ad73-fb2a7726ee9f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:24.610325 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-94184966-46ad-4708-b34a-34a0ecdfacac tempest-VolumesGetTestJSON-798856330 tempest-VolumesGetTestJSON-798856330-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/6d85a2fd-d75d-4965-b5b6-0cb08e16ca7b" status: 200 len: 353 microversion: 2.1 time: 0.083506 May 17 17:22:24.610712 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 33/69] 10.222.0.88 () {58 vars in 1244 bytes} [Tue May 17 17:22:24 2022] GET /compute/v2.1/os-volumes/6d85a2fd-d75d-4965-b5b6-0cb08e16ca7b => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:24.663458 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-abf69270-75ae-448f-ad73-fb2a7726ee9f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:24.671060 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-abf69270-75ae-448f-ad73-fb2a7726ee9f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1226 microversion: 2.1 time: 0.108307 May 17 17:22:24.671669 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 37/70] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:24 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:25.320462 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d4c2c688-a1c8-471c-8637-3156f0101c71 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:25.333062 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d4c2c688-a1c8-471c-8637-3156f0101c71 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:25.333062 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d4c2c688-a1c8-471c-8637-3156f0101c71 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:25.333062 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d4c2c688-a1c8-471c-8637-3156f0101c71 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:25.333062 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d4c2c688-a1c8-471c-8637-3156f0101c71 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:25.333478 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d4c2c688-a1c8-471c-8637-3156f0101c71 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:25.398870 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d4c2c688-a1c8-471c-8637-3156f0101c71 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:25.407132 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d4c2c688-a1c8-471c-8637-3156f0101c71 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1297 microversion: 2.1 time: 0.090700 May 17 17:22:25.407748 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 34/71] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:25 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1297 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:25.545750 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c5e6e95e-d7ec-456f-ae11-2b55407834d6 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:25.546458 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c5e6e95e-d7ec-456f-ae11-2b55407834d6 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:25.561714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c5e6e95e-d7ec-456f-ae11-2b55407834d6 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:25.562186 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c5e6e95e-d7ec-456f-ae11-2b55407834d6 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:25.566540 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c5e6e95e-d7ec-456f-ae11-2b55407834d6 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:25.567008 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c5e6e95e-d7ec-456f-ae11-2b55407834d6 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:25.570549 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-cbb86045-46e7-43c4-8a39-e5b527de451b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:25.571436 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-cbb86045-46e7-43c4-8a39-e5b527de451b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:25.584617 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cbb86045-46e7-43c4-8a39-e5b527de451b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:25.588205 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cbb86045-46e7-43c4-8a39-e5b527de451b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:25.589042 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cbb86045-46e7-43c4-8a39-e5b527de451b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:25.589487 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cbb86045-46e7-43c4-8a39-e5b527de451b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:25.737382 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-cbb86045-46e7-43c4-8a39-e5b527de451b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:25.746670 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-cbb86045-46e7-43c4-8a39-e5b527de451b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:25.748395 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-cbb86045-46e7-43c4-8a39-e5b527de451b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:25.749642 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-cbb86045-46e7-43c4-8a39-e5b527de451b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1278 microversion: 2.20 time: 0.184482 May 17 17:22:25.750414 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 35/72] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:25 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1278 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:22:25.766496 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b44eb489-5160-4700-b85d-9573b7039a40 tempest-VolumesGetTestJSON-798856330 tempest-VolumesGetTestJSON-798856330-project] Calling method '.version_select at 0x7f73d045a550>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:25.795090 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c5e6e95e-d7ec-456f-ae11-2b55407834d6 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:25.808447 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c5e6e95e-d7ec-456f-ae11-2b55407834d6 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1315 microversion: 2.1 time: 0.264098 May 17 17:22:25.809444 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 38/73] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:25 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:25.819878 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c354777e-c9e6-4925-a34c-45ebd02ffef2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:25.820600 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c354777e-c9e6-4925-a34c-45ebd02ffef2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:25.830227 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c354777e-c9e6-4925-a34c-45ebd02ffef2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:25.831213 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c354777e-c9e6-4925-a34c-45ebd02ffef2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:25.834485 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c354777e-c9e6-4925-a34c-45ebd02ffef2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:25.837945 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c354777e-c9e6-4925-a34c-45ebd02ffef2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:25.856408 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b44eb489-5160-4700-b85d-9573b7039a40 tempest-VolumesGetTestJSON-798856330 tempest-VolumesGetTestJSON-798856330-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/6d85a2fd-d75d-4965-b5b6-0cb08e16ca7b" status: 200 len: 354 microversion: 2.1 time: 0.104714 May 17 17:22:25.863555 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 36/74] 10.222.0.88 () {58 vars in 1244 bytes} [Tue May 17 17:22:25 2022] GET /compute/v2.1/os-volumes/6d85a2fd-d75d-4965-b5b6-0cb08e16ca7b => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:25.868782 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-2ab23745-9630-4261-9fca-b4915a12118a tempest-VolumesGetTestJSON-798856330 tempest-VolumesGetTestJSON-798856330-project] Calling method '.version_select at 0x7f73d04088b0>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:25.935639 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c354777e-c9e6-4925-a34c-45ebd02ffef2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:25.935952 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c354777e-c9e6-4925-a34c-45ebd02ffef2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1226 microversion: 2.1 time: 0.124988 May 17 17:22:25.936592 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 39/75] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:25 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1226 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:25.940601 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-2ab23745-9630-4261-9fca-b4915a12118a tempest-VolumesGetTestJSON-798856330 tempest-VolumesGetTestJSON-798856330-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/6d85a2fd-d75d-4965-b5b6-0cb08e16ca7b" status: 200 len: 354 microversion: 2.1 time: 0.075731 May 17 17:22:25.941452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 37/76] 10.222.0.88 () {58 vars in 1244 bytes} [Tue May 17 17:22:25 2022] GET /compute/v2.1/os-volumes/6d85a2fd-d75d-4965-b5b6-0cb08e16ca7b => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:25.952774 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f5006ed8-688e-47e6-a112-4c745e63d7af tempest-VolumesGetTestJSON-798856330 tempest-VolumesGetTestJSON-798856330-project] Calling method '.version_select at 0x7f73d0c3d940>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:26.197834 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f5006ed8-688e-47e6-a112-4c745e63d7af tempest-VolumesGetTestJSON-798856330 tempest-VolumesGetTestJSON-798856330-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/6d85a2fd-d75d-4965-b5b6-0cb08e16ca7b" status: 202 len: 0 microversion: 2.1 time: 0.248693 May 17 17:22:26.199602 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 40/77] 10.222.0.88 () {58 vars in 1247 bytes} [Tue May 17 17:22:25 2022] DELETE /compute/v2.1/os-volumes/6d85a2fd-d75d-4965-b5b6-0cb08e16ca7b => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:22:26.208429 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-0be7a675-6843-4daa-956c-4a42b2ffb3f3 tempest-VolumesGetTestJSON-798856330 tempest-VolumesGetTestJSON-798856330-project] Calling method '.version_select at 0x7f73d0478430>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:26.258373 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-0be7a675-6843-4daa-956c-4a42b2ffb3f3 tempest-VolumesGetTestJSON-798856330 tempest-VolumesGetTestJSON-798856330-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/6d85a2fd-d75d-4965-b5b6-0cb08e16ca7b" status: 200 len: 353 microversion: 2.1 time: 0.055612 May 17 17:22:26.258939 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 38/78] 10.222.0.88 () {58 vars in 1244 bytes} [Tue May 17 17:22:26 2022] GET /compute/v2.1/os-volumes/6d85a2fd-d75d-4965-b5b6-0cb08e16ca7b => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:22:26.531889 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b7adfe45-08bb-4303-98d3-4b9109603ae8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:26.531889 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b7adfe45-08bb-4303-98d3-4b9109603ae8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:26.531889 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b7adfe45-08bb-4303-98d3-4b9109603ae8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:26.531889 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b7adfe45-08bb-4303-98d3-4b9109603ae8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:26.532665 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b7adfe45-08bb-4303-98d3-4b9109603ae8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:26.532665 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b7adfe45-08bb-4303-98d3-4b9109603ae8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:26.532665 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b7adfe45-08bb-4303-98d3-4b9109603ae8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:26.532878 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b7adfe45-08bb-4303-98d3-4b9109603ae8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1297 microversion: 2.1 time: 0.085227 May 17 17:22:26.532878 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 41/79] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:26 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:26.768298 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-22d5c2a7-6b00-420c-9b5b-decbf00993ff tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:26.769666 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-22d5c2a7-6b00-420c-9b5b-decbf00993ff tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:26.781523 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-22d5c2a7-6b00-420c-9b5b-decbf00993ff tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:26.781881 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-22d5c2a7-6b00-420c-9b5b-decbf00993ff tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:26.786832 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-22d5c2a7-6b00-420c-9b5b-decbf00993ff tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:26.786832 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-22d5c2a7-6b00-420c-9b5b-decbf00993ff tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:26.826474 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-da009102-840b-405f-9c2b-24dcc8bdd91d tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:26.828021 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-da009102-840b-405f-9c2b-24dcc8bdd91d tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:26.954434 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-da009102-840b-405f-9c2b-24dcc8bdd91d tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:26.954434 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-da009102-840b-405f-9c2b-24dcc8bdd91d tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:26.954434 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-da009102-840b-405f-9c2b-24dcc8bdd91d tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:26.954434 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-da009102-840b-405f-9c2b-24dcc8bdd91d tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:26.954724 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-22d5c2a7-6b00-420c-9b5b-decbf00993ff tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:26.954724 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-22d5c2a7-6b00-420c-9b5b-decbf00993ff tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:26.954890 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-22d5c2a7-6b00-420c-9b5b-decbf00993ff tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:26.954890 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-22d5c2a7-6b00-420c-9b5b-decbf00993ff tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1278 microversion: 2.20 time: 0.112293 May 17 17:22:26.954890 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 39/80] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:26 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1278 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:22:26.955847 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-0d9d49c3-34e6-419a-bd0a-c4b45c344c80 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:26.957030 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-0d9d49c3-34e6-419a-bd0a-c4b45c344c80 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:26.963842 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0d9d49c3-34e6-419a-bd0a-c4b45c344c80 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:26.964284 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0d9d49c3-34e6-419a-bd0a-c4b45c344c80 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:26.965067 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0d9d49c3-34e6-419a-bd0a-c4b45c344c80 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:26.965820 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0d9d49c3-34e6-419a-bd0a-c4b45c344c80 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:26.992488 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-da009102-840b-405f-9c2b-24dcc8bdd91d tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:27.000786 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-da009102-840b-405f-9c2b-24dcc8bdd91d tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1315 microversion: 2.1 time: 0.178071 May 17 17:22:27.001569 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 42/81] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:26 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:27.033329 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-0d9d49c3-34e6-419a-bd0a-c4b45c344c80 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:27.042565 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-0d9d49c3-34e6-419a-bd0a-c4b45c344c80 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1226 microversion: 2.1 time: 0.093068 May 17 17:22:27.043464 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 40/82] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:26 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:22:27.271566 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b38fa3e2-1915-4ac4-b79c-754bd9b4f13e tempest-VolumesGetTestJSON-798856330 tempest-VolumesGetTestJSON-798856330-project] Calling method '.version_select at 0x7f73d03c6430>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:27.302895 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-b38fa3e2-1915-4ac4-b79c-754bd9b4f13e tempest-VolumesGetTestJSON-798856330 tempest-VolumesGetTestJSON-798856330-project] HTTP exception thrown: Volume 6d85a2fd-d75d-4965-b5b6-0cb08e16ca7b could not be found. May 17 17:22:27.305855 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b38fa3e2-1915-4ac4-b79c-754bd9b4f13e tempest-VolumesGetTestJSON-798856330 tempest-VolumesGetTestJSON-798856330-project] Request method failure captured: May 17 17:22:27.305855 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: request: GET /compute/v2.1/os-volumes/6d85a2fd-d75d-4965-b5b6-0cb08e16ca7b HTTP/1.1 May 17 17:22:27.305855 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 17 17:22:27.305855 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 17 17:22:27.305855 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Connection: close May 17 17:22:27.305855 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 17 17:22:27.305855 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 17 17:22:27.305855 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.88 May 17 17:22:27.305855 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 17 17:22:27.305855 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 17 17:22:27.305855 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABig9nK4radXdJQsd4JeeOxNlZDZpuR805yQ3LZcav_sW1f962LPURMO5UBGOnvez9A9uBm-UNoP5K1EJ-HXX8H0f_-TYgDS5Bd8uRYrx1FNPPneTzRecvm-idVl41AXXkZnwzA-ZuDjDL7Ki-QoTJVJXO7RkVXJmxciDEt6mQI8tOuP-w May 17 17:22:27.305855 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 17 17:22:27.305855 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 17 17:22:27.305855 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 17 17:22:27.305855 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 17 17:22:27.305855 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 17 17:22:27.305855 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 17 17:22:27.305855 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 5d03e70e91e64111bf96c555cd1d0292 May 17 17:22:27.305855 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-VolumesGetTestJSON-798856330 May 17 17:22:27.305855 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Role: reader,member May 17 17:22:27.305855 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Roles: reader,member May 17 17:22:27.307248 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5d03e70e91e64111bf96c555cd1d0292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5d03e70e91e64111bf96c555cd1d0292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5d03e70e91e64111bf96c555cd1d0292"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5d03e70e91e64111bf96c555cd1d0292", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:22:27.307248 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-VolumesGetTestJSON-798856330 May 17 17:22:27.307248 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 5d03e70e91e64111bf96c555cd1d0292 May 17 17:22:27.307248 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-VolumesGetTestJSON-798856330 May 17 17:22:27.307248 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User: tempest-VolumesGetTestJSON-798856330-project May 17 17:22:27.307248 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 17 17:22:27.307248 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 17 17:22:27.307248 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Id: 4b133fc752004c8fb5cadd907faac5e9 May 17 17:22:27.307248 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-VolumesGetTestJSON-798856330-project May 17 17:22:27.307248 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: method: May 17 17:22:27.307248 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: exception: Volume 6d85a2fd-d75d-4965-b5b6-0cb08e16ca7b could not be found. May 17 17:22:27.307248 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: action_args: {'id': '6d85a2fd-d75d-4965-b5b6-0cb08e16ca7b'} May 17 17:22:27.307248 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:22:27.308204 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:22:27.308204 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 17:22:27.308204 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 17:22:27.308204 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 17:22:27.308204 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 17:22:27.308204 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 17:22:27.308204 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 17:22:27.308204 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 17:22:27.308204 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 17:22:27.308204 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 17:22:27.308204 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 17:22:27.308204 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:22:27.308204 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:22:27.308204 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:22:27.308204 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:22:27.308204 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6d85a2fd-d75d-4965-b5b6-0cb08e16ca7b could not be found. (HTTP 404) (Request-ID: req-03af0b4d-2d26-4925-b8e1-b6cc25fd6fb1) May 17 17:22:27.308204 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:22:27.308204 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:22:27.308204 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:22:27.309656 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:22:27.309656 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 17 17:22:27.309656 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 17 17:22:27.309656 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 17:22:27.309656 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 17:22:27.309656 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 17:22:27.309656 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 17:22:27.309656 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 17:22:27.309656 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 17:22:27.309656 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 17:22:27.309656 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 17:22:27.309656 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 17:22:27.309656 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 17:22:27.309656 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 17:22:27.309656 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 17:22:27.309656 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 17:22:27.309656 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 17:22:27.309656 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 17:22:27.309656 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 17:22:27.310794 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 17:22:27.310794 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 17:22:27.310794 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 17:22:27.310794 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 17:22:27.310794 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6d85a2fd-d75d-4965-b5b6-0cb08e16ca7b could not be found. May 17 17:22:27.310794 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:22:27.310794 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:22:27.310794 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:22:27.310794 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:22:27.310794 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:22:27.310794 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:22:27.310794 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:22:27.310794 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:22:27.310794 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 17:22:27.310794 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 17:22:27.310794 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:22:27.310794 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:22:27.310794 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 17 17:22:27.310794 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:22:27.311980 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6d85a2fd-d75d-4965-b5b6-0cb08e16ca7b could not be found. May 17 17:22:27.311980 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:22:27.311980 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:22:27.311980 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:22:27.311980 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:22:27.311980 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:22:27.311980 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:22:27.311980 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:22:27.311980 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:22:27.311980 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6d85a2fd-d75d-4965-b5b6-0cb08e16ca7b could not be found. May 17 17:22:27.311980 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:22:27.312674 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b38fa3e2-1915-4ac4-b79c-754bd9b4f13e tempest-VolumesGetTestJSON-798856330 tempest-VolumesGetTestJSON-798856330-project] Returning 404 to user: Volume 6d85a2fd-d75d-4965-b5b6-0cb08e16ca7b could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:22:27.313363 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b38fa3e2-1915-4ac4-b79c-754bd9b4f13e tempest-VolumesGetTestJSON-798856330 tempest-VolumesGetTestJSON-798856330-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/6d85a2fd-d75d-4965-b5b6-0cb08e16ca7b" status: 404 len: 109 microversion: 2.1 time: 0.046618 May 17 17:22:27.313995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 43/83] 10.222.0.88 () {58 vars in 1244 bytes} [Tue May 17 17:22:27 2022] GET /compute/v2.1/os-volumes/6d85a2fd-d75d-4965-b5b6-0cb08e16ca7b => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:22:27.535449 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4bc3fa92-d8bd-47bc-b407-f9aa899bcfd5 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:27.536493 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4bc3fa92-d8bd-47bc-b407-f9aa899bcfd5 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:27.542334 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4bc3fa92-d8bd-47bc-b407-f9aa899bcfd5 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:27.542811 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4bc3fa92-d8bd-47bc-b407-f9aa899bcfd5 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:27.543854 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4bc3fa92-d8bd-47bc-b407-f9aa899bcfd5 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:27.544237 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4bc3fa92-d8bd-47bc-b407-f9aa899bcfd5 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:27.615608 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4bc3fa92-d8bd-47bc-b407-f9aa899bcfd5 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:27.628979 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4bc3fa92-d8bd-47bc-b407-f9aa899bcfd5 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1297 microversion: 2.1 time: 0.097709 May 17 17:22:27.638926 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 41/84] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:27 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1297 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:27.970120 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e3d0e9c8-6d5b-4baf-9fd5-fd548dc49c0b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:27.972995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e3d0e9c8-6d5b-4baf-9fd5-fd548dc49c0b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:27.978814 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e3d0e9c8-6d5b-4baf-9fd5-fd548dc49c0b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:27.979268 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e3d0e9c8-6d5b-4baf-9fd5-fd548dc49c0b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:27.980076 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e3d0e9c8-6d5b-4baf-9fd5-fd548dc49c0b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:27.980744 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e3d0e9c8-6d5b-4baf-9fd5-fd548dc49c0b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:28.020854 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-36e39748-4ba0-4d9d-aaa6-a15ed25e7147 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:28.027393 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-36e39748-4ba0-4d9d-aaa6-a15ed25e7147 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:28.030339 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-36e39748-4ba0-4d9d-aaa6-a15ed25e7147 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:28.031075 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-36e39748-4ba0-4d9d-aaa6-a15ed25e7147 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:28.032258 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-36e39748-4ba0-4d9d-aaa6-a15ed25e7147 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:28.033122 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-36e39748-4ba0-4d9d-aaa6-a15ed25e7147 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:28.330038 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e3d0e9c8-6d5b-4baf-9fd5-fd548dc49c0b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:28.343618 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e3d0e9c8-6d5b-4baf-9fd5-fd548dc49c0b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:28.343756 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e3d0e9c8-6d5b-4baf-9fd5-fd548dc49c0b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:28.345170 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e3d0e9c8-6d5b-4baf-9fd5-fd548dc49c0b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1278 microversion: 2.20 time: 0.378868 May 17 17:22:28.345728 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 44/85] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:27 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1278 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:22:28.350499 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6921dde9-c69a-49df-967a-1fcc2890fc0e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:28.352216 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6921dde9-c69a-49df-967a-1fcc2890fc0e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:28.363627 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6921dde9-c69a-49df-967a-1fcc2890fc0e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:28.363627 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6921dde9-c69a-49df-967a-1fcc2890fc0e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:28.363627 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6921dde9-c69a-49df-967a-1fcc2890fc0e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:28.363627 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6921dde9-c69a-49df-967a-1fcc2890fc0e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:28.486513 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6921dde9-c69a-49df-967a-1fcc2890fc0e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:28.489936 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6921dde9-c69a-49df-967a-1fcc2890fc0e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1226 microversion: 2.1 time: 0.143076 May 17 17:22:28.499200 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 45/86] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:28 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1226 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:28.547946 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-36e39748-4ba0-4d9d-aaa6-a15ed25e7147 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:28.555153 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-36e39748-4ba0-4d9d-aaa6-a15ed25e7147 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1315 microversion: 2.1 time: 0.539491 May 17 17:22:28.556126 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 42/87] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:28 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1315 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:22:28.646928 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7b1a5af7-b5d6-46c4-a92b-9b8c90c88971 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:28.647681 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-7b1a5af7-b5d6-46c4-a92b-9b8c90c88971 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:28.653842 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7b1a5af7-b5d6-46c4-a92b-9b8c90c88971 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:28.654683 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7b1a5af7-b5d6-46c4-a92b-9b8c90c88971 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:28.656725 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7b1a5af7-b5d6-46c4-a92b-9b8c90c88971 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:28.657193 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7b1a5af7-b5d6-46c4-a92b-9b8c90c88971 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:28.724108 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7b1a5af7-b5d6-46c4-a92b-9b8c90c88971 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:28.732564 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7b1a5af7-b5d6-46c4-a92b-9b8c90c88971 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1297 microversion: 2.1 time: 0.090473 May 17 17:22:28.737502 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 46/88] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:28 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1297 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:22:29.362057 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-fb254369-6849-4422-bb86-4ff67bf946db tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:29.363761 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-fb254369-6849-4422-bb86-4ff67bf946db tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:29.369713 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fb254369-6849-4422-bb86-4ff67bf946db tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:29.370324 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fb254369-6849-4422-bb86-4ff67bf946db tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:29.371253 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fb254369-6849-4422-bb86-4ff67bf946db tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:29.371858 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fb254369-6849-4422-bb86-4ff67bf946db tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:29.470491 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-fb254369-6849-4422-bb86-4ff67bf946db tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:29.482214 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-fb254369-6849-4422-bb86-4ff67bf946db tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:29.483690 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-fb254369-6849-4422-bb86-4ff67bf946db tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:29.485027 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-fb254369-6849-4422-bb86-4ff67bf946db tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1334 microversion: 2.20 time: 0.126718 May 17 17:22:29.485584 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 43/89] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:29 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1334 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:22:29.507078 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ce25d607-e9ba-4697-88ae-e21f401ed5a1 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:29.507846 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ce25d607-e9ba-4697-88ae-e21f401ed5a1 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:29.514147 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ce25d607-e9ba-4697-88ae-e21f401ed5a1 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:29.519446 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ce25d607-e9ba-4697-88ae-e21f401ed5a1 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:29.519446 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ce25d607-e9ba-4697-88ae-e21f401ed5a1 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:29.519446 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ce25d607-e9ba-4697-88ae-e21f401ed5a1 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:29.571386 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a734f61d-0bea-4d82-b49f-0039250d32ba tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:29.576445 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a734f61d-0bea-4d82-b49f-0039250d32ba tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:29.585728 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a734f61d-0bea-4d82-b49f-0039250d32ba tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:29.586370 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a734f61d-0bea-4d82-b49f-0039250d32ba tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:29.587318 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a734f61d-0bea-4d82-b49f-0039250d32ba tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:29.587920 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a734f61d-0bea-4d82-b49f-0039250d32ba tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:29.595964 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ce25d607-e9ba-4697-88ae-e21f401ed5a1 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:29.611271 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ce25d607-e9ba-4697-88ae-e21f401ed5a1 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1226 microversion: 2.1 time: 0.108826 May 17 17:22:29.612526 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 47/90] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:29 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1226 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:29.740890 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a734f61d-0bea-4d82-b49f-0039250d32ba tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:29.748225 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a734f61d-0bea-4d82-b49f-0039250d32ba tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1315 microversion: 2.1 time: 0.180552 May 17 17:22:29.748805 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 44/91] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:29 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:22:29.751382 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-49c71cad-250b-4e06-b477-323b17c5b345 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:29.752062 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-49c71cad-250b-4e06-b477-323b17c5b345 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:29.758781 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-49c71cad-250b-4e06-b477-323b17c5b345 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:29.759309 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-49c71cad-250b-4e06-b477-323b17c5b345 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:29.760263 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-49c71cad-250b-4e06-b477-323b17c5b345 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:29.760907 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-49c71cad-250b-4e06-b477-323b17c5b345 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:29.832964 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-49c71cad-250b-4e06-b477-323b17c5b345 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:29.843131 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-49c71cad-250b-4e06-b477-323b17c5b345 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1297 microversion: 2.1 time: 0.095092 May 17 17:22:29.843392 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 48/92] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:29 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1297 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:30.510459 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-786ed165-9ac4-4153-b3b8-87afdb02a38a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:30.511002 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-786ed165-9ac4-4153-b3b8-87afdb02a38a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:30.516865 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-786ed165-9ac4-4153-b3b8-87afdb02a38a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:30.517311 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-786ed165-9ac4-4153-b3b8-87afdb02a38a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:30.518075 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-786ed165-9ac4-4153-b3b8-87afdb02a38a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:30.518511 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-786ed165-9ac4-4153-b3b8-87afdb02a38a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:30.589652 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-786ed165-9ac4-4153-b3b8-87afdb02a38a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:30.599146 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-786ed165-9ac4-4153-b3b8-87afdb02a38a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:30.604463 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-786ed165-9ac4-4153-b3b8-87afdb02a38a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:30.604463 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-786ed165-9ac4-4153-b3b8-87afdb02a38a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1334 microversion: 2.20 time: 0.095579 May 17 17:22:30.604463 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 45/93] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:30 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1334 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:22:30.628837 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2f3ad08e-5076-42c1-a454-e8371c8ec1e6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:30.633280 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2f3ad08e-5076-42c1-a454-e8371c8ec1e6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:30.635264 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2f3ad08e-5076-42c1-a454-e8371c8ec1e6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:30.635929 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2f3ad08e-5076-42c1-a454-e8371c8ec1e6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:30.636701 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2f3ad08e-5076-42c1-a454-e8371c8ec1e6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:30.637133 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2f3ad08e-5076-42c1-a454-e8371c8ec1e6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:30.698876 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2f3ad08e-5076-42c1-a454-e8371c8ec1e6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:30.709905 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2f3ad08e-5076-42c1-a454-e8371c8ec1e6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1226 microversion: 2.1 time: 0.081676 May 17 17:22:30.709905 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 49/94] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:30 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:30.765052 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f9fffd5b-eb15-4c8a-ab4e-82e029814e53 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:30.766141 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f9fffd5b-eb15-4c8a-ab4e-82e029814e53 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:30.773302 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f9fffd5b-eb15-4c8a-ab4e-82e029814e53 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:30.773771 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f9fffd5b-eb15-4c8a-ab4e-82e029814e53 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:30.774581 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f9fffd5b-eb15-4c8a-ab4e-82e029814e53 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:30.775017 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f9fffd5b-eb15-4c8a-ab4e-82e029814e53 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:30.860791 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-45883138-6224-4b30-b978-8d93ed50bdae tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:30.862265 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-45883138-6224-4b30-b978-8d93ed50bdae tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:30.873027 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-45883138-6224-4b30-b978-8d93ed50bdae tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:30.875753 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-45883138-6224-4b30-b978-8d93ed50bdae tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:30.876885 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-45883138-6224-4b30-b978-8d93ed50bdae tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:30.881128 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-45883138-6224-4b30-b978-8d93ed50bdae tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:31.062059 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-45883138-6224-4b30-b978-8d93ed50bdae tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:31.078840 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-45883138-6224-4b30-b978-8d93ed50bdae tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1297 microversion: 2.1 time: 0.223211 May 17 17:22:31.085944 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 50/95] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:30 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1297 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:22:31.202460 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f9fffd5b-eb15-4c8a-ab4e-82e029814e53 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:31.211431 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f9fffd5b-eb15-4c8a-ab4e-82e029814e53 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1315 microversion: 2.1 time: 0.450489 May 17 17:22:31.212116 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 46/96] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:30 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:31.620016 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c53f8e16-ab74-4241-aa3e-3d46580a3bc4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:31.620635 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c53f8e16-ab74-4241-aa3e-3d46580a3bc4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:31.626631 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c53f8e16-ab74-4241-aa3e-3d46580a3bc4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:31.627088 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c53f8e16-ab74-4241-aa3e-3d46580a3bc4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:31.627899 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c53f8e16-ab74-4241-aa3e-3d46580a3bc4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:31.629015 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c53f8e16-ab74-4241-aa3e-3d46580a3bc4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:31.693391 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c53f8e16-ab74-4241-aa3e-3d46580a3bc4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:31.701398 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c53f8e16-ab74-4241-aa3e-3d46580a3bc4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:31.703043 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c53f8e16-ab74-4241-aa3e-3d46580a3bc4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:31.704280 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c53f8e16-ab74-4241-aa3e-3d46580a3bc4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1334 microversion: 2.20 time: 0.088271 May 17 17:22:31.704829 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 51/97] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:31 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1334 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:22:31.723654 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-2b1badcb-1962-4822-97ea-6de82f3e11c2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:31.725039 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-2b1badcb-1962-4822-97ea-6de82f3e11c2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:31.731301 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2b1badcb-1962-4822-97ea-6de82f3e11c2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:31.732397 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2b1badcb-1962-4822-97ea-6de82f3e11c2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:31.733670 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2b1badcb-1962-4822-97ea-6de82f3e11c2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:31.734283 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2b1badcb-1962-4822-97ea-6de82f3e11c2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:31.833620 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2b1badcb-1962-4822-97ea-6de82f3e11c2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:31.842519 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-2b1badcb-1962-4822-97ea-6de82f3e11c2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1218 microversion: 2.1 time: 0.124175 May 17 17:22:31.856371 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 47/98] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:31 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1218 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:32.102985 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-de725499-4dd3-4c2a-8172-321c46ecf9e8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:32.103636 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-de725499-4dd3-4c2a-8172-321c46ecf9e8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:32.113933 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-de725499-4dd3-4c2a-8172-321c46ecf9e8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:32.114411 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-de725499-4dd3-4c2a-8172-321c46ecf9e8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:32.118580 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-de725499-4dd3-4c2a-8172-321c46ecf9e8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:32.118580 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-de725499-4dd3-4c2a-8172-321c46ecf9e8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:32.229551 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-604340ca-d37d-4816-b65c-d0207d3b2b34 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:32.230317 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-604340ca-d37d-4816-b65c-d0207d3b2b34 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:32.244980 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-604340ca-d37d-4816-b65c-d0207d3b2b34 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:32.249619 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-604340ca-d37d-4816-b65c-d0207d3b2b34 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:32.249619 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-604340ca-d37d-4816-b65c-d0207d3b2b34 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:32.249619 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-604340ca-d37d-4816-b65c-d0207d3b2b34 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:32.323284 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-de725499-4dd3-4c2a-8172-321c46ecf9e8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:32.354514 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-de725499-4dd3-4c2a-8172-321c46ecf9e8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1307 microversion: 2.1 time: 0.250199 May 17 17:22:32.355301 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 52/99] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:32 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1307 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:32.399216 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3a426b6a-a121-4206-9e54-70e6037e309c tempest-VolumesTestJSON-869627462 tempest-VolumesTestJSON-869627462-project] Calling method '.version_select at 0x7f73d03fc550>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:32.453804 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3a426b6a-a121-4206-9e54-70e6037e309c tempest-VolumesTestJSON-869627462 tempest-VolumesTestJSON-869627462-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/b3915acf-153f-428a-af28-eafdaa1b0139" status: 200 len: 349 microversion: 2.1 time: 0.058265 May 17 17:22:32.454381 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 53/100] 10.222.0.88 () {58 vars in 1244 bytes} [Tue May 17 17:22:32 2022] GET /compute/v2.1/os-volumes/b3915acf-153f-428a-af28-eafdaa1b0139 => generated 349 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:22:32.674855 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-604340ca-d37d-4816-b65c-d0207d3b2b34 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:32.686432 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-604340ca-d37d-4816-b65c-d0207d3b2b34 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1315 microversion: 2.1 time: 0.460789 May 17 17:22:32.696843 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 48/101] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:32 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:32.723791 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-79ea4dca-c249-4822-99f0-076723e54670 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:32.724518 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-79ea4dca-c249-4822-99f0-076723e54670 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:32.733340 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-79ea4dca-c249-4822-99f0-076723e54670 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:32.734196 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-79ea4dca-c249-4822-99f0-076723e54670 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:32.735369 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-79ea4dca-c249-4822-99f0-076723e54670 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:32.736068 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-79ea4dca-c249-4822-99f0-076723e54670 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:32.863729 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f12f59c1-aafd-403b-a840-0d407154bcb6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:32.865147 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f12f59c1-aafd-403b-a840-0d407154bcb6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:32.871559 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f12f59c1-aafd-403b-a840-0d407154bcb6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:32.872090 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f12f59c1-aafd-403b-a840-0d407154bcb6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:32.872945 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f12f59c1-aafd-403b-a840-0d407154bcb6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:32.873476 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f12f59c1-aafd-403b-a840-0d407154bcb6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:32.938973 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-79ea4dca-c249-4822-99f0-076723e54670 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:32.948215 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-79ea4dca-c249-4822-99f0-076723e54670 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:32.950640 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-79ea4dca-c249-4822-99f0-076723e54670 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:32.952192 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-79ea4dca-c249-4822-99f0-076723e54670 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1342 microversion: 2.20 time: 0.233747 May 17 17:22:32.963966 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 54/102] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:32 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1342 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:22:33.086074 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f12f59c1-aafd-403b-a840-0d407154bcb6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:33.094962 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f12f59c1-aafd-403b-a840-0d407154bcb6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1274 microversion: 2.1 time: 0.235214 May 17 17:22:33.097581 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 49/103] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:32 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1274 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:22:33.371845 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c00a76de-e531-457c-9287-df4f17e0265f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:33.374019 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c00a76de-e531-457c-9287-df4f17e0265f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:33.382919 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c00a76de-e531-457c-9287-df4f17e0265f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:33.383623 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c00a76de-e531-457c-9287-df4f17e0265f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:33.384798 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c00a76de-e531-457c-9287-df4f17e0265f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:33.390078 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c00a76de-e531-457c-9287-df4f17e0265f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:33.568591 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c00a76de-e531-457c-9287-df4f17e0265f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:33.575853 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c00a76de-e531-457c-9287-df4f17e0265f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1295 microversion: 2.1 time: 0.207845 May 17 17:22:33.576431 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 55/104] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:33 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1295 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:33.707917 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d372ddbd-2686-4196-a6b2-f46aed174e35 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:33.707917 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d372ddbd-2686-4196-a6b2-f46aed174e35 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:33.716681 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d372ddbd-2686-4196-a6b2-f46aed174e35 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:33.717128 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d372ddbd-2686-4196-a6b2-f46aed174e35 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:33.720880 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d372ddbd-2686-4196-a6b2-f46aed174e35 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:33.722576 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d372ddbd-2686-4196-a6b2-f46aed174e35 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:33.971818 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c8b9271a-2400-41e4-a69f-b6f3a98a581d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:33.974238 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c8b9271a-2400-41e4-a69f-b6f3a98a581d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:33.985897 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c8b9271a-2400-41e4-a69f-b6f3a98a581d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:33.988846 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c8b9271a-2400-41e4-a69f-b6f3a98a581d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:33.991112 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c8b9271a-2400-41e4-a69f-b6f3a98a581d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:33.993458 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c8b9271a-2400-41e4-a69f-b6f3a98a581d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:34.155505 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c8b9271a-2400-41e4-a69f-b6f3a98a581d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:34.163854 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c8b9271a-2400-41e4-a69f-b6f3a98a581d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:34.167050 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c8b9271a-2400-41e4-a69f-b6f3a98a581d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:34.168271 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c8b9271a-2400-41e4-a69f-b6f3a98a581d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1340 microversion: 2.20 time: 0.200994 May 17 17:22:34.169093 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 56/105] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:33 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1340 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:22:34.184521 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-54ee7479-f296-49e2-b384-0e4d28bad28d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:34.185319 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-54ee7479-f296-49e2-b384-0e4d28bad28d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:34.192148 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-54ee7479-f296-49e2-b384-0e4d28bad28d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:34.192601 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-54ee7479-f296-49e2-b384-0e4d28bad28d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:34.194047 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-54ee7479-f296-49e2-b384-0e4d28bad28d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:34.194047 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-54ee7479-f296-49e2-b384-0e4d28bad28d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:34.199243 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d372ddbd-2686-4196-a6b2-f46aed174e35 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:34.208634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d372ddbd-2686-4196-a6b2-f46aed174e35 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1315 microversion: 2.1 time: 0.508812 May 17 17:22:34.210406 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 50/106] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:33 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1315 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:34.214914 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ea9f445d-8f2a-47cb-b6a7-d66a0cd42a33 tempest-VolumesTestJSON-869627462 tempest-VolumesTestJSON-869627462-project] Calling method '.version_select at 0x7f73d0478160>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:34.287790 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ea9f445d-8f2a-47cb-b6a7-d66a0cd42a33 tempest-VolumesTestJSON-869627462 tempest-VolumesTestJSON-869627462-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/cf29fe55-0191-4e6a-a784-1376b8433d3a" status: 200 len: 351 microversion: 2.1 time: 0.076288 May 17 17:22:34.294938 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 51/107] 10.222.0.88 () {58 vars in 1244 bytes} [Tue May 17 17:22:34 2022] GET /compute/v2.1/os-volumes/cf29fe55-0191-4e6a-a784-1376b8433d3a => generated 351 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:34.421957 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-54ee7479-f296-49e2-b384-0e4d28bad28d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:34.432277 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-54ee7479-f296-49e2-b384-0e4d28bad28d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1280 microversion: 2.1 time: 0.251376 May 17 17:22:34.432852 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 57/108] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:34 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1280 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:34.593739 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-bb16c135-e638-4229-a312-ae4e3ee3d1fe tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:34.594366 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-bb16c135-e638-4229-a312-ae4e3ee3d1fe tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:34.602613 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bb16c135-e638-4229-a312-ae4e3ee3d1fe tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:34.606394 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bb16c135-e638-4229-a312-ae4e3ee3d1fe tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:34.607239 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bb16c135-e638-4229-a312-ae4e3ee3d1fe tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:34.607715 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bb16c135-e638-4229-a312-ae4e3ee3d1fe tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:35.007894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-bb16c135-e638-4229-a312-ae4e3ee3d1fe tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:35.022029 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-bb16c135-e638-4229-a312-ae4e3ee3d1fe tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1363 microversion: 2.1 time: 0.432200 May 17 17:22:35.023735 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 52/109] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:34 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1363 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:35.186373 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-41d9c0bc-9edc-4dca-a874-8a5f6fbbb3d6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:35.187625 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-41d9c0bc-9edc-4dca-a874-8a5f6fbbb3d6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:35.197253 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-41d9c0bc-9edc-4dca-a874-8a5f6fbbb3d6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:35.197253 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-41d9c0bc-9edc-4dca-a874-8a5f6fbbb3d6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:35.197253 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-41d9c0bc-9edc-4dca-a874-8a5f6fbbb3d6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:35.197253 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-41d9c0bc-9edc-4dca-a874-8a5f6fbbb3d6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:35.227222 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1abfa322-405a-445b-b18e-87a48133e9a4 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:35.228033 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1abfa322-405a-445b-b18e-87a48133e9a4 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:35.235356 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1abfa322-405a-445b-b18e-87a48133e9a4 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:35.237361 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1abfa322-405a-445b-b18e-87a48133e9a4 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:35.237361 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1abfa322-405a-445b-b18e-87a48133e9a4 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:35.237361 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1abfa322-405a-445b-b18e-87a48133e9a4 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:35.576970 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-1abfa322-405a-445b-b18e-87a48133e9a4 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:35.584933 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1abfa322-405a-445b-b18e-87a48133e9a4 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1315 microversion: 2.1 time: 0.361483 May 17 17:22:35.585121 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-41d9c0bc-9edc-4dca-a874-8a5f6fbbb3d6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:35.585502 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 53/110] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:35 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:22:35.590880 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-988757f2-7767-4ec9-8cc6-15512c6373b3 req-1b2d03c1-b4ee-4e7e-b562-0419174ff8c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ea4b9c8-340b-4cd6-abdd-419071fc0b0d", "tag": "f77db53d-6f2a-4604-ba2c-92c6f8dfd30b"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:22:35.595763 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-41d9c0bc-9edc-4dca-a874-8a5f6fbbb3d6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:35.598005 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-41d9c0bc-9edc-4dca-a874-8a5f6fbbb3d6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:35.603820 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-41d9c0bc-9edc-4dca-a874-8a5f6fbbb3d6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1406 microversion: 2.20 time: 0.416878 May 17 17:22:35.603820 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 58/111] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:35 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1406 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:22:35.604008 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-988757f2-7767-4ec9-8cc6-15512c6373b3 req-1b2d03c1-b4ee-4e7e-b562-0419174ff8c7 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:35.604008 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-988757f2-7767-4ec9-8cc6-15512c6373b3 req-1b2d03c1-b4ee-4e7e-b562-0419174ff8c7 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:35.608808 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-86e44088-028b-40af-b2f2-400d491d36b2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:35.609557 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-86e44088-028b-40af-b2f2-400d491d36b2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:35.617456 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-86e44088-028b-40af-b2f2-400d491d36b2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:35.617982 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-86e44088-028b-40af-b2f2-400d491d36b2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:35.618880 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-86e44088-028b-40af-b2f2-400d491d36b2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:35.619432 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-86e44088-028b-40af-b2f2-400d491d36b2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:35.623965 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-988757f2-7767-4ec9-8cc6-15512c6373b3 req-1b2d03c1-b4ee-4e7e-b562-0419174ff8c7 service nova] Creating event network-changed:f77db53d-6f2a-4604-ba2c-92c6f8dfd30b for instance 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d on hv-cinder-84214 May 17 17:22:35.624495 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-988757f2-7767-4ec9-8cc6-15512c6373b3 req-1b2d03c1-b4ee-4e7e-b562-0419174ff8c7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 17 17:22:35.625937 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d79d96a3-6b77-48cd-a30d-8da6062f2f74 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:35.626030 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d79d96a3-6b77-48cd-a30d-8da6062f2f74 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:35.626849 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d79d96a3-6b77-48cd-a30d-8da6062f2f74 None None] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:35.627275 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d79d96a3-6b77-48cd-a30d-8da6062f2f74 None None] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:35.636124 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.compute.rpcapi [None req-d79d96a3-6b77-48cd-a30d-8da6062f2f74 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 17 17:22:35.637177 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d79d96a3-6b77-48cd-a30d-8da6062f2f74 None None] Releasing lock "compute-rpcapi-router" {{(pid=117611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 17 17:22:35.668379 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d79d96a3-6b77-48cd-a30d-8da6062f2f74 None None] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081455 May 17 17:22:35.669864 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 54/112] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:35.812536 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-86e44088-028b-40af-b2f2-400d491d36b2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:35.820030 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-86e44088-028b-40af-b2f2-400d491d36b2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1322 microversion: 2.1 time: 0.218993 May 17 17:22:35.821388 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 59/113] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:35 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:36.041527 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a9b71722-6cae-44df-a2f1-4f68fbc53138 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:36.042251 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a9b71722-6cae-44df-a2f1-4f68fbc53138 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:36.048999 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a9b71722-6cae-44df-a2f1-4f68fbc53138 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:36.049110 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a9b71722-6cae-44df-a2f1-4f68fbc53138 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:36.049847 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a9b71722-6cae-44df-a2f1-4f68fbc53138 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:36.050288 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a9b71722-6cae-44df-a2f1-4f68fbc53138 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:36.180001 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a9b71722-6cae-44df-a2f1-4f68fbc53138 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:36.187259 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a9b71722-6cae-44df-a2f1-4f68fbc53138 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1363 microversion: 2.1 time: 0.149917 May 17 17:22:36.188613 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 55/114] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:36 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:36.601867 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-94625b45-bd33-44d5-beea-ccc02df15007 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:36.602473 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-94625b45-bd33-44d5-beea-ccc02df15007 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:36.608316 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-94625b45-bd33-44d5-beea-ccc02df15007 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:36.608763 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-94625b45-bd33-44d5-beea-ccc02df15007 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:36.609524 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-94625b45-bd33-44d5-beea-ccc02df15007 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:36.609953 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-94625b45-bd33-44d5-beea-ccc02df15007 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:36.618732 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-dba07332-4be4-4db0-8397-8559d0451b68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:36.620030 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-dba07332-4be4-4db0-8397-8559d0451b68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:36.626758 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-dba07332-4be4-4db0-8397-8559d0451b68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:36.627207 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-dba07332-4be4-4db0-8397-8559d0451b68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:36.628504 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-dba07332-4be4-4db0-8397-8559d0451b68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:36.628941 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-dba07332-4be4-4db0-8397-8559d0451b68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:36.812131 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-94625b45-bd33-44d5-beea-ccc02df15007 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:36.815222 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-dba07332-4be4-4db0-8397-8559d0451b68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:36.821080 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-94625b45-bd33-44d5-beea-ccc02df15007 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1315 microversion: 2.1 time: 0.223186 May 17 17:22:36.821963 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 60/115] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:36 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:36.834868 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-dba07332-4be4-4db0-8397-8559d0451b68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:36.834868 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-dba07332-4be4-4db0-8397-8559d0451b68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:36.835657 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-dba07332-4be4-4db0-8397-8559d0451b68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1406 microversion: 2.20 time: 0.221960 May 17 17:22:36.835767 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d0142368-e315-44e7-834b-0208abde5398 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:36.836279 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 56/116] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:36 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:22:36.836696 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d0142368-e315-44e7-834b-0208abde5398 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:36.842721 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d0142368-e315-44e7-834b-0208abde5398 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:36.845691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d0142368-e315-44e7-834b-0208abde5398 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:36.845691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d0142368-e315-44e7-834b-0208abde5398 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:36.845691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d0142368-e315-44e7-834b-0208abde5398 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:36.972803 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d0142368-e315-44e7-834b-0208abde5398 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:36.980188 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d0142368-e315-44e7-834b-0208abde5398 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1322 microversion: 2.1 time: 0.148017 May 17 17:22:36.980746 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 61/117] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:36 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:37.205249 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8be0a13c-d6f6-4f39-bb6c-c385d76f3070 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:37.206103 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8be0a13c-d6f6-4f39-bb6c-c385d76f3070 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:37.212586 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8be0a13c-d6f6-4f39-bb6c-c385d76f3070 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:37.213045 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8be0a13c-d6f6-4f39-bb6c-c385d76f3070 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:37.213830 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8be0a13c-d6f6-4f39-bb6c-c385d76f3070 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:37.214596 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8be0a13c-d6f6-4f39-bb6c-c385d76f3070 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:37.671479 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8be0a13c-d6f6-4f39-bb6c-c385d76f3070 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:37.678879 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8be0a13c-d6f6-4f39-bb6c-c385d76f3070 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1363 microversion: 2.1 time: 0.478887 May 17 17:22:37.679643 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 57/118] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:37 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1363 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:37.838807 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-eee1bcea-9e4e-426f-a481-56aa3514b602 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:37.840193 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-eee1bcea-9e4e-426f-a481-56aa3514b602 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:37.853311 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eee1bcea-9e4e-426f-a481-56aa3514b602 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:37.854046 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eee1bcea-9e4e-426f-a481-56aa3514b602 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:37.854997 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eee1bcea-9e4e-426f-a481-56aa3514b602 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:37.855615 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eee1bcea-9e4e-426f-a481-56aa3514b602 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:37.856443 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1dd88d17-9978-4753-832c-5915f4c1630e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:37.857272 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1dd88d17-9978-4753-832c-5915f4c1630e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:37.864867 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1dd88d17-9978-4753-832c-5915f4c1630e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:37.867757 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1dd88d17-9978-4753-832c-5915f4c1630e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:37.868890 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1dd88d17-9978-4753-832c-5915f4c1630e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:37.869756 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1dd88d17-9978-4753-832c-5915f4c1630e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:38.708705 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-1dd88d17-9978-4753-832c-5915f4c1630e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:38.725121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-1dd88d17-9978-4753-832c-5915f4c1630e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:38.726926 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-1dd88d17-9978-4753-832c-5915f4c1630e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:38.732605 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1dd88d17-9978-4753-832c-5915f4c1630e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1406 microversion: 2.20 time: 0.882272 May 17 17:22:38.733448 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 58/119] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:37 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1406 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:22:38.743385 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-44eea9aa-d15e-453d-a0c6-5d7b4d683095 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:38.744608 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-44eea9aa-d15e-453d-a0c6-5d7b4d683095 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:38.760315 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-44eea9aa-d15e-453d-a0c6-5d7b4d683095 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:38.761411 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-44eea9aa-d15e-453d-a0c6-5d7b4d683095 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:38.762815 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-44eea9aa-d15e-453d-a0c6-5d7b4d683095 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:38.765357 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-44eea9aa-d15e-453d-a0c6-5d7b4d683095 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:38.903403 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-eee1bcea-9e4e-426f-a481-56aa3514b602 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:38.913845 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-eee1bcea-9e4e-426f-a481-56aa3514b602 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1315 microversion: 2.1 time: 1.079238 May 17 17:22:38.914574 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 62/120] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:37 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1315 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:39.071046 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-ce008dd0-b0ce-40e7-829e-685d54969775 req-7c42b492-d917-4b57-9dde-070213fa1985 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44", "tag": "88984695-6cd9-4b4c-b02c-9f8d26d785d7"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:22:39.091544 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-ce008dd0-b0ce-40e7-829e-685d54969775 req-7c42b492-d917-4b57-9dde-070213fa1985 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:39.092024 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-ce008dd0-b0ce-40e7-829e-685d54969775 req-7c42b492-d917-4b57-9dde-070213fa1985 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:39.101904 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-44eea9aa-d15e-453d-a0c6-5d7b4d683095 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:39.104703 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-ce008dd0-b0ce-40e7-829e-685d54969775 req-7c42b492-d917-4b57-9dde-070213fa1985 service nova] Creating event network-changed:88984695-6cd9-4b4c-b02c-9f8d26d785d7 for instance bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 on hv-cinder-84214 May 17 17:22:39.109950 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-ce008dd0-b0ce-40e7-829e-685d54969775 req-7c42b492-d917-4b57-9dde-070213fa1985 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194095 May 17 17:22:39.110531 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-44eea9aa-d15e-453d-a0c6-5d7b4d683095 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1322 microversion: 2.1 time: 0.375643 May 17 17:22:39.110655 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 63/121] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:39.111372 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 59/122] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:38 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1322 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:39.116747 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c0746b0b-1ddf-4862-ada3-34217ad1ed04 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:39.117511 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c0746b0b-1ddf-4862-ada3-34217ad1ed04 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:39.123956 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-826a00cb-f5dd-41e7-ab36-5297e54ccd88 tempest-VolumesTestJSON-869627462 tempest-VolumesTestJSON-869627462-project] Calling method '.version_select at 0x7f73d038be50>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:39.126780 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c0746b0b-1ddf-4862-ada3-34217ad1ed04 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:39.127456 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c0746b0b-1ddf-4862-ada3-34217ad1ed04 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:39.128349 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c0746b0b-1ddf-4862-ada3-34217ad1ed04 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:39.128847 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c0746b0b-1ddf-4862-ada3-34217ad1ed04 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:39.181119 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-826a00cb-f5dd-41e7-ab36-5297e54ccd88 tempest-VolumesTestJSON-869627462 tempest-VolumesTestJSON-869627462-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/858d423b-6eed-4132-82ab-d24238b5c43e" status: 200 len: 351 microversion: 2.1 time: 0.063798 May 17 17:22:39.181119 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 64/123] 10.222.0.88 () {58 vars in 1244 bytes} [Tue May 17 17:22:39 2022] GET /compute/v2.1/os-volumes/858d423b-6eed-4132-82ab-d24238b5c43e => generated 351 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:39.251825 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-ab423656-25d1-4c2e-85df-5d637f7001dc req-a3ed206f-9545-4527-a2f9-8f92edea8ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "086aec45-2c47-4b06-9fc9-a19c44a3673a", "name": "network-vif-plugged", "status": "completed", "tag": "cd951b9f-179e-4c54-9050-7b2c81ed2b23"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:22:39.277659 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-ab423656-25d1-4c2e-85df-5d637f7001dc req-a3ed206f-9545-4527-a2f9-8f92edea8ed5 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:39.278109 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-ab423656-25d1-4c2e-85df-5d637f7001dc req-a3ed206f-9545-4527-a2f9-8f92edea8ed5 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:39.290747 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-ab423656-25d1-4c2e-85df-5d637f7001dc req-a3ed206f-9545-4527-a2f9-8f92edea8ed5 service nova] Creating event network-vif-plugged:cd951b9f-179e-4c54-9050-7b2c81ed2b23 for instance 086aec45-2c47-4b06-9fc9-a19c44a3673a on hv-cinder-84214 May 17 17:22:39.296128 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-ab423656-25d1-4c2e-85df-5d637f7001dc req-a3ed206f-9545-4527-a2f9-8f92edea8ed5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116685 May 17 17:22:39.297341 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 65/124] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:39.303821 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-92424dca-87c2-4e07-b315-322001b8ed50 tempest-VolumesTestJSON-869627462 tempest-VolumesTestJSON-869627462-project] Calling method '.version_select at 0x7f73d16d6f70>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:39.436077 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-92424dca-87c2-4e07-b315-322001b8ed50 tempest-VolumesTestJSON-869627462 tempest-VolumesTestJSON-869627462-project] 10.222.0.88 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.137253 May 17 17:22:39.436659 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 66/125] 10.222.0.88 () {58 vars in 1133 bytes} [Tue May 17 17:22:39 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:39.450924 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b84593d8-83bd-4d21-a01a-47253ad9969d tempest-VolumesTestJSON-869627462 tempest-VolumesTestJSON-869627462-project] Calling method '.version_select at 0x7f73d03fc160>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:39.529484 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c0746b0b-1ddf-4862-ada3-34217ad1ed04 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:39.538231 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c0746b0b-1ddf-4862-ada3-34217ad1ed04 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1363 microversion: 2.1 time: 0.425187 May 17 17:22:39.538700 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 60/126] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:39 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1363 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:39.581741 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b84593d8-83bd-4d21-a01a-47253ad9969d tempest-VolumesTestJSON-869627462 tempest-VolumesTestJSON-869627462-project] 10.222.0.88 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.136311 May 17 17:22:39.583617 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 67/127] 10.222.0.88 () {58 vars in 1148 bytes} [Tue May 17 17:22:39 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:39.598682 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-58a08e97-2719-49b8-960a-617a21be0be9 tempest-VolumesTestJSON-869627462 tempest-VolumesTestJSON-869627462-project] Calling method '.version_select at 0x7f73d0478b80>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:39.703684 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-58a08e97-2719-49b8-960a-617a21be0be9 tempest-VolumesTestJSON-869627462 tempest-VolumesTestJSON-869627462-project] 10.222.0.88 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.110381 May 17 17:22:39.711073 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 61/128] 10.222.0.88 () {58 vars in 1133 bytes} [Tue May 17 17:22:39 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:39.711692 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-8f73a9d8-c154-482a-b586-308500abf7a3 req-35f502e3-0b89-44b3-a1c6-947e4fbafdba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6849325b-2caa-4f21-945b-bff1e4f6b564", "tag": "8994f556-9e5d-412d-b043-6c3d04fc35e4"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:22:39.717036 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-265f4b0b-8e1f-4e68-bd57-663f15a87d68 tempest-VolumesTestJSON-869627462 tempest-VolumesTestJSON-869627462-project] Calling method '.version_select at 0x7f73d043cf70>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:39.724238 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-8f73a9d8-c154-482a-b586-308500abf7a3 req-35f502e3-0b89-44b3-a1c6-947e4fbafdba service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:39.729955 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-8f73a9d8-c154-482a-b586-308500abf7a3 req-35f502e3-0b89-44b3-a1c6-947e4fbafdba service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:39.737876 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-8f73a9d8-c154-482a-b586-308500abf7a3 req-35f502e3-0b89-44b3-a1c6-947e4fbafdba service nova] Creating event network-changed:8994f556-9e5d-412d-b043-6c3d04fc35e4 for instance 6849325b-2caa-4f21-945b-bff1e4f6b564 on hv-cinder-84214 May 17 17:22:39.760093 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-8f73a9d8-c154-482a-b586-308500abf7a3 req-35f502e3-0b89-44b3-a1c6-947e4fbafdba service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053146 May 17 17:22:39.764363 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 68/129] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:39.774977 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5f0be078-a1a2-4f9f-81a2-872218a7d452 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:39.775757 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5f0be078-a1a2-4f9f-81a2-872218a7d452 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:39.784551 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5f0be078-a1a2-4f9f-81a2-872218a7d452 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:39.785005 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5f0be078-a1a2-4f9f-81a2-872218a7d452 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:39.787099 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5f0be078-a1a2-4f9f-81a2-872218a7d452 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:39.793681 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5f0be078-a1a2-4f9f-81a2-872218a7d452 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:39.865977 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-265f4b0b-8e1f-4e68-bd57-663f15a87d68 tempest-VolumesTestJSON-869627462 tempest-VolumesTestJSON-869627462-project] 10.222.0.88 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.153625 May 17 17:22:39.866556 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 62/130] 10.222.0.88 () {58 vars in 1166 bytes} [Tue May 17 17:22:39 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:22:39.885960 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-89f11f63-6692-4b87-bab8-bab93654a023 tempest-VolumesTestJSON-869627462 tempest-VolumesTestJSON-869627462-project] Calling method '.version_select at 0x7f73d04ba040>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:40.020855 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-89f11f63-6692-4b87-bab8-bab93654a023 tempest-VolumesTestJSON-869627462 tempest-VolumesTestJSON-869627462-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.146132 May 17 17:22:40.022538 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 63/131] 10.222.0.88 () {58 vars in 1169 bytes} [Tue May 17 17:22:39 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:40.028101 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-188410ff-a0a0-469e-acd8-19c95bf1cfd7 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:40.028998 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-188410ff-a0a0-469e-acd8-19c95bf1cfd7 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:40.031176 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5f0be078-a1a2-4f9f-81a2-872218a7d452 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:40.038680 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-188410ff-a0a0-469e-acd8-19c95bf1cfd7 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:40.039343 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-188410ff-a0a0-469e-acd8-19c95bf1cfd7 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:40.040964 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-188410ff-a0a0-469e-acd8-19c95bf1cfd7 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:40.041349 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5f0be078-a1a2-4f9f-81a2-872218a7d452 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:40.041719 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-188410ff-a0a0-469e-acd8-19c95bf1cfd7 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:40.043042 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5f0be078-a1a2-4f9f-81a2-872218a7d452 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:40.048498 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5f0be078-a1a2-4f9f-81a2-872218a7d452 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1406 microversion: 2.20 time: 0.286408 May 17 17:22:40.049418 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 69/132] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:39 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1406 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:22:40.054273 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e8027308-5526-4f4d-bb02-54c9948eb24a tempest-VolumesTestJSON-869627462 tempest-VolumesTestJSON-869627462-project] Calling method '.version_select at 0x7f73d03fcf70>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:40.153851 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e8027308-5526-4f4d-bb02-54c9948eb24a tempest-VolumesTestJSON-869627462 tempest-VolumesTestJSON-869627462-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.103288 May 17 17:22:40.155145 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 70/133] 10.222.0.88 () {58 vars in 1154 bytes} [Tue May 17 17:22:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:40.160014 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c0632e0e-f53d-4830-92a0-3f05fbdfce09 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:40.161001 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c0632e0e-f53d-4830-92a0-3f05fbdfce09 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:40.167977 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c0632e0e-f53d-4830-92a0-3f05fbdfce09 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:40.168557 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c0632e0e-f53d-4830-92a0-3f05fbdfce09 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:40.169450 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c0632e0e-f53d-4830-92a0-3f05fbdfce09 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:40.169977 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c0632e0e-f53d-4830-92a0-3f05fbdfce09 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:40.217495 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-188410ff-a0a0-469e-acd8-19c95bf1cfd7 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:40.224137 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-188410ff-a0a0-469e-acd8-19c95bf1cfd7 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1315 microversion: 2.1 time: 0.200328 May 17 17:22:40.224709 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 64/134] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:40 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:40.229132 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-40069fee-5e33-4c9b-a6a0-f8c1e1d57345 tempest-VolumesTestJSON-869627462 tempest-VolumesTestJSON-869627462-project] Calling method '.version_select at 0x7f73d0478790>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:40.329978 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-40069fee-5e33-4c9b-a6a0-f8c1e1d57345 tempest-VolumesTestJSON-869627462 tempest-VolumesTestJSON-869627462-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.099799 May 17 17:22:40.332388 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c0632e0e-f53d-4830-92a0-3f05fbdfce09 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:40.332525 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 65/135] 10.222.0.88 () {58 vars in 1187 bytes} [Tue May 17 17:22:40 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:40.342775 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ae9b6bcd-b294-47d5-af14-3b1137b371c1 tempest-VolumesTestJSON-869627462 tempest-VolumesTestJSON-869627462-project] Calling method '.version_select at 0x7f73d045adc0>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:40.343551 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c0632e0e-f53d-4830-92a0-3f05fbdfce09 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1322 microversion: 2.1 time: 0.187149 May 17 17:22:40.344604 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 71/136] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:40 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:40.432884 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ae9b6bcd-b294-47d5-af14-3b1137b371c1 tempest-VolumesTestJSON-869627462 tempest-VolumesTestJSON-869627462-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.093773 May 17 17:22:40.433467 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 66/137] 10.222.0.88 () {58 vars in 1154 bytes} [Tue May 17 17:22:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:40.553774 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-305202e9-4fb8-4dae-9c64-255a2aa357cd tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:40.554379 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-305202e9-4fb8-4dae-9c64-255a2aa357cd tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:40.560352 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-305202e9-4fb8-4dae-9c64-255a2aa357cd tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:40.560797 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-305202e9-4fb8-4dae-9c64-255a2aa357cd tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:40.561558 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-305202e9-4fb8-4dae-9c64-255a2aa357cd tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:40.561990 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-305202e9-4fb8-4dae-9c64-255a2aa357cd tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:40.700833 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-305202e9-4fb8-4dae-9c64-255a2aa357cd tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:40.709127 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-305202e9-4fb8-4dae-9c64-255a2aa357cd tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1363 microversion: 2.1 time: 0.159010 May 17 17:22:40.710192 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 72/138] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:40 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:41.065909 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f22d4d31-6671-4985-b545-be88e20985fc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:41.066510 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f22d4d31-6671-4985-b545-be88e20985fc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:41.073036 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f22d4d31-6671-4985-b545-be88e20985fc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:41.073482 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f22d4d31-6671-4985-b545-be88e20985fc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:41.074248 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f22d4d31-6671-4985-b545-be88e20985fc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:41.074676 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f22d4d31-6671-4985-b545-be88e20985fc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:41.202200 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f22d4d31-6671-4985-b545-be88e20985fc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:41.209878 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f22d4d31-6671-4985-b545-be88e20985fc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:41.212976 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f22d4d31-6671-4985-b545-be88e20985fc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:41.212976 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f22d4d31-6671-4985-b545-be88e20985fc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1406 microversion: 2.20 time: 0.151016 May 17 17:22:41.213179 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 67/139] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:41 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:22:41.240756 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e6fa2e38-33f1-4738-80c1-f4856330fe1e tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:41.241381 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e6fa2e38-33f1-4738-80c1-f4856330fe1e tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:41.247336 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e6fa2e38-33f1-4738-80c1-f4856330fe1e tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:41.247824 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e6fa2e38-33f1-4738-80c1-f4856330fe1e tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:41.248586 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e6fa2e38-33f1-4738-80c1-f4856330fe1e tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:41.249022 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e6fa2e38-33f1-4738-80c1-f4856330fe1e tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:41.360944 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1c2d8eac-ba29-4638-9d1f-8f851160bf8e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:41.361558 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1c2d8eac-ba29-4638-9d1f-8f851160bf8e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:41.368230 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1c2d8eac-ba29-4638-9d1f-8f851160bf8e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:41.368677 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1c2d8eac-ba29-4638-9d1f-8f851160bf8e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:41.369455 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1c2d8eac-ba29-4638-9d1f-8f851160bf8e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:41.369888 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1c2d8eac-ba29-4638-9d1f-8f851160bf8e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:41.380292 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e6fa2e38-33f1-4738-80c1-f4856330fe1e tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:41.387435 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e6fa2e38-33f1-4738-80c1-f4856330fe1e tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1315 microversion: 2.1 time: 0.151043 May 17 17:22:41.388090 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 73/140] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:41 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:41.500868 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-1c2d8eac-ba29-4638-9d1f-8f851160bf8e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:41.508653 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1c2d8eac-ba29-4638-9d1f-8f851160bf8e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1322 microversion: 2.1 time: 0.151654 May 17 17:22:41.509214 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 68/141] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:41 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:22:41.726405 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c70b9eab-5405-43e1-adac-0ec61ec48a65 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:41.727021 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c70b9eab-5405-43e1-adac-0ec61ec48a65 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:41.732743 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c70b9eab-5405-43e1-adac-0ec61ec48a65 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:41.733199 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c70b9eab-5405-43e1-adac-0ec61ec48a65 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:41.733961 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c70b9eab-5405-43e1-adac-0ec61ec48a65 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:41.734395 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c70b9eab-5405-43e1-adac-0ec61ec48a65 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:41.783432 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-79807b77-198f-429f-896c-35cba459c7d8 req-d1ea3161-9442-4833-8757-056e21138051 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a87018c-9e2f-4322-8472-dbe43085332f", "tag": "724c5ba3-c6a4-4624-8067-3660e3e44690"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:22:41.791845 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-79807b77-198f-429f-896c-35cba459c7d8 req-d1ea3161-9442-4833-8757-056e21138051 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:41.792384 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-79807b77-198f-429f-896c-35cba459c7d8 req-d1ea3161-9442-4833-8757-056e21138051 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:41.803689 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-79807b77-198f-429f-896c-35cba459c7d8 req-d1ea3161-9442-4833-8757-056e21138051 service nova] Creating event network-changed:724c5ba3-c6a4-4624-8067-3660e3e44690 for instance 3a87018c-9e2f-4322-8472-dbe43085332f on hv-cinder-84214 May 17 17:22:41.808854 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-79807b77-198f-429f-896c-35cba459c7d8 req-d1ea3161-9442-4833-8757-056e21138051 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029171 May 17 17:22:41.809867 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 69/142] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:22:41.865794 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c70b9eab-5405-43e1-adac-0ec61ec48a65 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:41.872995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c70b9eab-5405-43e1-adac-0ec61ec48a65 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1363 microversion: 2.1 time: 0.150375 May 17 17:22:41.873548 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 74/143] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:41 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:42.231230 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3cd91558-7c06-4da3-b92e-0b5320bca78a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:42.231956 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3cd91558-7c06-4da3-b92e-0b5320bca78a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:42.238430 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3cd91558-7c06-4da3-b92e-0b5320bca78a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:42.238889 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3cd91558-7c06-4da3-b92e-0b5320bca78a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:42.239759 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3cd91558-7c06-4da3-b92e-0b5320bca78a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:42.240227 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3cd91558-7c06-4da3-b92e-0b5320bca78a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:42.367367 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3cd91558-7c06-4da3-b92e-0b5320bca78a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:42.375112 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3cd91558-7c06-4da3-b92e-0b5320bca78a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:42.376659 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3cd91558-7c06-4da3-b92e-0b5320bca78a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:42.378290 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3cd91558-7c06-4da3-b92e-0b5320bca78a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1406 microversion: 2.20 time: 0.150814 May 17 17:22:42.378842 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 70/144] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:42 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:22:42.408552 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7681be64-9817-4213-80df-85133b12dfbc tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:42.409260 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-7681be64-9817-4213-80df-85133b12dfbc tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:42.416420 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7681be64-9817-4213-80df-85133b12dfbc tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:42.416979 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7681be64-9817-4213-80df-85133b12dfbc tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:42.417824 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7681be64-9817-4213-80df-85133b12dfbc tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:42.418340 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7681be64-9817-4213-80df-85133b12dfbc tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:42.525368 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-bc29022b-1c3f-4458-ad3b-87ebea1da03d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:42.525980 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-bc29022b-1c3f-4458-ad3b-87ebea1da03d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:42.532169 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bc29022b-1c3f-4458-ad3b-87ebea1da03d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:42.532615 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bc29022b-1c3f-4458-ad3b-87ebea1da03d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:42.533387 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bc29022b-1c3f-4458-ad3b-87ebea1da03d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:42.533854 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bc29022b-1c3f-4458-ad3b-87ebea1da03d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:42.545188 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7681be64-9817-4213-80df-85133b12dfbc tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:42.552472 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7681be64-9817-4213-80df-85133b12dfbc tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1315 microversion: 2.1 time: 0.147636 May 17 17:22:42.553026 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 75/145] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:42 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:42.662977 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-bc29022b-1c3f-4458-ad3b-87ebea1da03d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:42.670260 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-bc29022b-1c3f-4458-ad3b-87ebea1da03d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1322 microversion: 2.1 time: 0.148718 May 17 17:22:42.670826 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 71/146] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:42 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:22:42.889912 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-71bdb441-9db0-4f13-a835-89008ceabe59 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:42.890518 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-71bdb441-9db0-4f13-a835-89008ceabe59 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:42.896413 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-71bdb441-9db0-4f13-a835-89008ceabe59 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:42.897342 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-71bdb441-9db0-4f13-a835-89008ceabe59 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:42.897697 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-71bdb441-9db0-4f13-a835-89008ceabe59 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:42.898139 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-71bdb441-9db0-4f13-a835-89008ceabe59 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:43.025292 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-71bdb441-9db0-4f13-a835-89008ceabe59 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:43.032629 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-71bdb441-9db0-4f13-a835-89008ceabe59 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1363 microversion: 2.1 time: 0.146534 May 17 17:22:43.033203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 76/147] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:42 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:22:43.396297 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ff27e655-1042-43f8-bb8c-61c17fabbe3a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:43.396936 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ff27e655-1042-43f8-bb8c-61c17fabbe3a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:43.403081 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ff27e655-1042-43f8-bb8c-61c17fabbe3a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:43.403550 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ff27e655-1042-43f8-bb8c-61c17fabbe3a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:43.404645 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ff27e655-1042-43f8-bb8c-61c17fabbe3a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:43.405076 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ff27e655-1042-43f8-bb8c-61c17fabbe3a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:43.532813 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ff27e655-1042-43f8-bb8c-61c17fabbe3a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:43.541387 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ff27e655-1042-43f8-bb8c-61c17fabbe3a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:43.542947 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ff27e655-1042-43f8-bb8c-61c17fabbe3a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:43.544138 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ff27e655-1042-43f8-bb8c-61c17fabbe3a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1406 microversion: 2.20 time: 0.151702 May 17 17:22:43.544699 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 72/148] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:43 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:22:43.569012 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-961a5513-b15b-4259-9b78-03eea044cd98 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:43.569580 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-961a5513-b15b-4259-9b78-03eea044cd98 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:43.575349 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-961a5513-b15b-4259-9b78-03eea044cd98 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:43.575829 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-961a5513-b15b-4259-9b78-03eea044cd98 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:43.576582 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-961a5513-b15b-4259-9b78-03eea044cd98 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:43.577006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-961a5513-b15b-4259-9b78-03eea044cd98 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:43.690169 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e51e889a-4201-45ae-9c27-5a1c33af9df2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:43.690981 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e51e889a-4201-45ae-9c27-5a1c33af9df2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:43.697865 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e51e889a-4201-45ae-9c27-5a1c33af9df2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:43.698321 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e51e889a-4201-45ae-9c27-5a1c33af9df2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:43.699102 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e51e889a-4201-45ae-9c27-5a1c33af9df2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:43.699576 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e51e889a-4201-45ae-9c27-5a1c33af9df2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:43.723067 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-961a5513-b15b-4259-9b78-03eea044cd98 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:43.730472 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-961a5513-b15b-4259-9b78-03eea044cd98 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1315 microversion: 2.1 time: 0.165352 May 17 17:22:43.731047 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 77/149] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:43 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:43.836971 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e51e889a-4201-45ae-9c27-5a1c33af9df2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:43.844202 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e51e889a-4201-45ae-9c27-5a1c33af9df2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1322 microversion: 2.1 time: 0.160028 May 17 17:22:43.844770 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 73/150] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:43 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:22:44.049883 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2c290b97-37dd-4ccf-bc7e-b9ff378d5e72 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:44.050542 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2c290b97-37dd-4ccf-bc7e-b9ff378d5e72 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:44.056301 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2c290b97-37dd-4ccf-bc7e-b9ff378d5e72 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:44.056746 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2c290b97-37dd-4ccf-bc7e-b9ff378d5e72 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:44.057506 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2c290b97-37dd-4ccf-bc7e-b9ff378d5e72 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:44.057940 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2c290b97-37dd-4ccf-bc7e-b9ff378d5e72 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:44.185519 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2c290b97-37dd-4ccf-bc7e-b9ff378d5e72 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:44.193189 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2c290b97-37dd-4ccf-bc7e-b9ff378d5e72 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1363 microversion: 2.1 time: 0.147114 May 17 17:22:44.193759 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 78/151] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:44 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:44.561914 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ff2c6888-e1fc-4488-a368-b2e16ec8ea3e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:44.562547 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ff2c6888-e1fc-4488-a368-b2e16ec8ea3e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:44.568523 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ff2c6888-e1fc-4488-a368-b2e16ec8ea3e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:44.568977 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ff2c6888-e1fc-4488-a368-b2e16ec8ea3e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:44.569741 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ff2c6888-e1fc-4488-a368-b2e16ec8ea3e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:44.570179 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ff2c6888-e1fc-4488-a368-b2e16ec8ea3e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:44.696381 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ff2c6888-e1fc-4488-a368-b2e16ec8ea3e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:44.704089 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ff2c6888-e1fc-4488-a368-b2e16ec8ea3e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:44.705620 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ff2c6888-e1fc-4488-a368-b2e16ec8ea3e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:44.707228 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ff2c6888-e1fc-4488-a368-b2e16ec8ea3e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1406 microversion: 2.20 time: 0.149158 May 17 17:22:44.707831 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 74/152] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:44 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:22:44.748036 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2d0f42dc-fa07-430d-9224-76c9c8f79f07 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:44.748648 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2d0f42dc-fa07-430d-9224-76c9c8f79f07 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:44.754981 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2d0f42dc-fa07-430d-9224-76c9c8f79f07 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:44.755429 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2d0f42dc-fa07-430d-9224-76c9c8f79f07 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:44.756217 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2d0f42dc-fa07-430d-9224-76c9c8f79f07 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:44.756644 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2d0f42dc-fa07-430d-9224-76c9c8f79f07 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:44.867463 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e85e29cd-1b62-4e0d-a41c-270dc94a9e4f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:44.868212 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e85e29cd-1b62-4e0d-a41c-270dc94a9e4f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:44.874377 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e85e29cd-1b62-4e0d-a41c-270dc94a9e4f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:44.882234 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e85e29cd-1b62-4e0d-a41c-270dc94a9e4f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:44.882234 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e85e29cd-1b62-4e0d-a41c-270dc94a9e4f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:44.882234 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e85e29cd-1b62-4e0d-a41c-270dc94a9e4f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:44.886691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2d0f42dc-fa07-430d-9224-76c9c8f79f07 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:44.894642 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2d0f42dc-fa07-430d-9224-76c9c8f79f07 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1315 microversion: 2.1 time: 0.150421 May 17 17:22:44.895284 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 79/153] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:44 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:45.161939 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e85e29cd-1b62-4e0d-a41c-270dc94a9e4f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:45.169701 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e85e29cd-1b62-4e0d-a41c-270dc94a9e4f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1322 microversion: 2.1 time: 0.306227 May 17 17:22:45.170307 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 75/154] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:44 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1322 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:22:45.210305 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a6c4ec5e-68b6-4d1e-92cc-82e0ee9b10e0 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:45.211155 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a6c4ec5e-68b6-4d1e-92cc-82e0ee9b10e0 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:45.217436 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a6c4ec5e-68b6-4d1e-92cc-82e0ee9b10e0 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:45.218053 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a6c4ec5e-68b6-4d1e-92cc-82e0ee9b10e0 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:45.218843 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a6c4ec5e-68b6-4d1e-92cc-82e0ee9b10e0 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:45.219771 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a6c4ec5e-68b6-4d1e-92cc-82e0ee9b10e0 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:45.726254 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f8b00e55-d8c3-4a03-9cce-a95258d29870 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:45.726902 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f8b00e55-d8c3-4a03-9cce-a95258d29870 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:45.727818 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a6c4ec5e-68b6-4d1e-92cc-82e0ee9b10e0 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:45.733071 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8b00e55-d8c3-4a03-9cce-a95258d29870 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:45.733355 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8b00e55-d8c3-4a03-9cce-a95258d29870 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:45.734117 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8b00e55-d8c3-4a03-9cce-a95258d29870 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:45.734541 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8b00e55-d8c3-4a03-9cce-a95258d29870 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:45.736608 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a6c4ec5e-68b6-4d1e-92cc-82e0ee9b10e0 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1363 microversion: 2.1 time: 0.530162 May 17 17:22:45.741286 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 80/155] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:45 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1363 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:45.873662 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f8b00e55-d8c3-4a03-9cce-a95258d29870 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:45.881743 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f8b00e55-d8c3-4a03-9cce-a95258d29870 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:45.883247 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f8b00e55-d8c3-4a03-9cce-a95258d29870 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:45.884396 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f8b00e55-d8c3-4a03-9cce-a95258d29870 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1406 microversion: 2.20 time: 0.162991 May 17 17:22:45.884955 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 76/156] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:45 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:22:45.911243 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-50272896-c3a8-4939-a6d4-fc3bc76802e0 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:45.911884 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-50272896-c3a8-4939-a6d4-fc3bc76802e0 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:45.917693 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-50272896-c3a8-4939-a6d4-fc3bc76802e0 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:45.918148 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-50272896-c3a8-4939-a6d4-fc3bc76802e0 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:45.918918 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-50272896-c3a8-4939-a6d4-fc3bc76802e0 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:45.920153 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-50272896-c3a8-4939-a6d4-fc3bc76802e0 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:46.052151 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-50272896-c3a8-4939-a6d4-fc3bc76802e0 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:46.061177 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-50272896-c3a8-4939-a6d4-fc3bc76802e0 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1315 microversion: 2.1 time: 0.153661 May 17 17:22:46.061914 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 81/157] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:45 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:46.187116 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-38109f44-050c-4113-ae38-8c635f5a4c7e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:46.187777 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-38109f44-050c-4113-ae38-8c635f5a4c7e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:46.193997 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-38109f44-050c-4113-ae38-8c635f5a4c7e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:46.194439 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-38109f44-050c-4113-ae38-8c635f5a4c7e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:46.195208 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-38109f44-050c-4113-ae38-8c635f5a4c7e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:46.195669 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-38109f44-050c-4113-ae38-8c635f5a4c7e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:46.324123 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-38109f44-050c-4113-ae38-8c635f5a4c7e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:46.332076 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-38109f44-050c-4113-ae38-8c635f5a4c7e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1322 microversion: 2.1 time: 0.149239 May 17 17:22:46.332646 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 77/158] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:46 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:22:46.754385 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-46f0de1a-a87a-49ba-9450-43dadfb43b6a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:46.755262 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-46f0de1a-a87a-49ba-9450-43dadfb43b6a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:46.763789 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-46f0de1a-a87a-49ba-9450-43dadfb43b6a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:46.766434 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-46f0de1a-a87a-49ba-9450-43dadfb43b6a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:46.768659 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-46f0de1a-a87a-49ba-9450-43dadfb43b6a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:46.769240 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-46f0de1a-a87a-49ba-9450-43dadfb43b6a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:46.902296 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d49c632b-07e0-4bfc-aed4-af784437d63f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:46.903008 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d49c632b-07e0-4bfc-aed4-af784437d63f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:46.910545 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d49c632b-07e0-4bfc-aed4-af784437d63f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:46.911029 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d49c632b-07e0-4bfc-aed4-af784437d63f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:46.911987 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d49c632b-07e0-4bfc-aed4-af784437d63f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:46.912580 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d49c632b-07e0-4bfc-aed4-af784437d63f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:47.173058 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-46f0de1a-a87a-49ba-9450-43dadfb43b6a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:47.183890 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-46f0de1a-a87a-49ba-9450-43dadfb43b6a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1363 microversion: 2.1 time: 0.433770 May 17 17:22:47.185046 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 82/159] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:46 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1363 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:47.189847 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-bc910c62-b827-43c5-b723-a7c76d145f96 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:47.190693 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-bc910c62-b827-43c5-b723-a7c76d145f96 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:47.196877 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bc910c62-b827-43c5-b723-a7c76d145f96 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:47.197600 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bc910c62-b827-43c5-b723-a7c76d145f96 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:47.198477 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bc910c62-b827-43c5-b723-a7c76d145f96 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:47.198976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bc910c62-b827-43c5-b723-a7c76d145f96 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:47.204769 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d49c632b-07e0-4bfc-aed4-af784437d63f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:47.218583 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d49c632b-07e0-4bfc-aed4-af784437d63f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:47.226880 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d49c632b-07e0-4bfc-aed4-af784437d63f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:47.229503 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d49c632b-07e0-4bfc-aed4-af784437d63f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1406 microversion: 2.20 time: 0.331010 May 17 17:22:47.230079 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 78/160] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:46 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1406 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:22:47.350172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-94b64c82-56aa-4c8a-a270-7d0e9e309df8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:47.350795 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-94b64c82-56aa-4c8a-a270-7d0e9e309df8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:47.352584 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-bc910c62-b827-43c5-b723-a7c76d145f96 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:47.358534 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-94b64c82-56aa-4c8a-a270-7d0e9e309df8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:47.359232 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-94b64c82-56aa-4c8a-a270-7d0e9e309df8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:47.360419 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-94b64c82-56aa-4c8a-a270-7d0e9e309df8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:47.361101 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-94b64c82-56aa-4c8a-a270-7d0e9e309df8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:47.361225 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-bc910c62-b827-43c5-b723-a7c76d145f96 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1315 microversion: 2.1 time: 0.174872 May 17 17:22:47.370572 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 83/161] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:47 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:47.538369 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-94b64c82-56aa-4c8a-a270-7d0e9e309df8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:47.547086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-94b64c82-56aa-4c8a-a270-7d0e9e309df8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1322 microversion: 2.1 time: 0.201729 May 17 17:22:47.548164 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 79/162] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:47 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:22:48.200697 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-edccb526-db18-4a04-9ad7-c420b499e1b0 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:48.201300 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-edccb526-db18-4a04-9ad7-c420b499e1b0 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:48.207938 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-edccb526-db18-4a04-9ad7-c420b499e1b0 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:48.208569 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-edccb526-db18-4a04-9ad7-c420b499e1b0 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:48.209338 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-edccb526-db18-4a04-9ad7-c420b499e1b0 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:48.209820 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-edccb526-db18-4a04-9ad7-c420b499e1b0 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:48.248285 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3500f99c-6039-44de-bdcd-5478fcdee6f4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:48.249116 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3500f99c-6039-44de-bdcd-5478fcdee6f4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:48.258129 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3500f99c-6039-44de-bdcd-5478fcdee6f4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:48.258963 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3500f99c-6039-44de-bdcd-5478fcdee6f4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:48.259779 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3500f99c-6039-44de-bdcd-5478fcdee6f4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:48.262790 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3500f99c-6039-44de-bdcd-5478fcdee6f4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:48.389524 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-edccb526-db18-4a04-9ad7-c420b499e1b0 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:48.397396 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-edccb526-db18-4a04-9ad7-c420b499e1b0 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1363 microversion: 2.1 time: 0.200543 May 17 17:22:48.397958 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 84/163] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:48 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:48.402564 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-744de274-89b1-4622-8665-804245ac9583 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:48.407299 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-744de274-89b1-4622-8665-804245ac9583 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:48.412089 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-744de274-89b1-4622-8665-804245ac9583 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:48.412712 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-744de274-89b1-4622-8665-804245ac9583 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:48.413255 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-744de274-89b1-4622-8665-804245ac9583 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:48.413701 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-744de274-89b1-4622-8665-804245ac9583 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:48.434353 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3500f99c-6039-44de-bdcd-5478fcdee6f4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:48.444576 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3500f99c-6039-44de-bdcd-5478fcdee6f4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:48.446508 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3500f99c-6039-44de-bdcd-5478fcdee6f4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:48.447838 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3500f99c-6039-44de-bdcd-5478fcdee6f4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1406 microversion: 2.20 time: 0.204340 May 17 17:22:48.448406 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 80/164] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:48 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:22:48.564521 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-609016b0-9898-416c-a3f7-98b4dc532255 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:48.565686 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-609016b0-9898-416c-a3f7-98b4dc532255 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:48.578593 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-609016b0-9898-416c-a3f7-98b4dc532255 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:48.579047 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-609016b0-9898-416c-a3f7-98b4dc532255 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:48.579994 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-609016b0-9898-416c-a3f7-98b4dc532255 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:48.580499 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-609016b0-9898-416c-a3f7-98b4dc532255 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:48.686489 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-744de274-89b1-4622-8665-804245ac9583 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:48.693823 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-744de274-89b1-4622-8665-804245ac9583 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1315 microversion: 2.1 time: 0.294871 May 17 17:22:48.694461 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 85/165] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:48 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:48.857457 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-609016b0-9898-416c-a3f7-98b4dc532255 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:48.868456 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-609016b0-9898-416c-a3f7-98b4dc532255 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1322 microversion: 2.1 time: 0.307864 May 17 17:22:48.870115 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 81/166] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:48 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:22:48.944871 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-7f65e0ef-f11d-45ce-ab8c-55ad26ff0c3f req-d7c7eb0d-025d-46dd-bece-f687dfe46768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a87018c-9e2f-4322-8472-dbe43085332f", "name": "network-vif-plugged", "status": "completed", "tag": "724c5ba3-c6a4-4624-8067-3660e3e44690"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:22:48.952829 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-7f65e0ef-f11d-45ce-ab8c-55ad26ff0c3f req-d7c7eb0d-025d-46dd-bece-f687dfe46768 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:48.953346 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-7f65e0ef-f11d-45ce-ab8c-55ad26ff0c3f req-d7c7eb0d-025d-46dd-bece-f687dfe46768 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:48.965528 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-7f65e0ef-f11d-45ce-ab8c-55ad26ff0c3f req-d7c7eb0d-025d-46dd-bece-f687dfe46768 service nova] Creating event network-vif-plugged:724c5ba3-c6a4-4624-8067-3660e3e44690 for instance 3a87018c-9e2f-4322-8472-dbe43085332f on hv-cinder-84214 May 17 17:22:48.970386 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-7f65e0ef-f11d-45ce-ab8c-55ad26ff0c3f req-d7c7eb0d-025d-46dd-bece-f687dfe46768 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029196 May 17 17:22:48.971021 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 86/167] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:49.417117 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d4f9d2ff-cd09-40b3-a042-80a4f779cce7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:49.417935 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d4f9d2ff-cd09-40b3-a042-80a4f779cce7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:49.423691 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d4f9d2ff-cd09-40b3-a042-80a4f779cce7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:49.424317 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d4f9d2ff-cd09-40b3-a042-80a4f779cce7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:49.425778 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d4f9d2ff-cd09-40b3-a042-80a4f779cce7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:49.425778 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d4f9d2ff-cd09-40b3-a042-80a4f779cce7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:49.466885 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c414df12-5f1f-4e1c-962d-306fa8e99be4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:49.467932 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c414df12-5f1f-4e1c-962d-306fa8e99be4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:49.475811 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c414df12-5f1f-4e1c-962d-306fa8e99be4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:49.476522 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c414df12-5f1f-4e1c-962d-306fa8e99be4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:49.477468 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c414df12-5f1f-4e1c-962d-306fa8e99be4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:49.478049 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c414df12-5f1f-4e1c-962d-306fa8e99be4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:49.626376 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d4f9d2ff-cd09-40b3-a042-80a4f779cce7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:49.633870 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d4f9d2ff-cd09-40b3-a042-80a4f779cce7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1363 microversion: 2.1 time: 0.222930 May 17 17:22:49.643892 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 82/168] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:49 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:49.706029 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c414df12-5f1f-4e1c-962d-306fa8e99be4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:49.709895 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d8d71211-6789-4f0d-9e54-f7c1d7a9355c tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:49.710506 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d8d71211-6789-4f0d-9e54-f7c1d7a9355c tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:49.714540 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c414df12-5f1f-4e1c-962d-306fa8e99be4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:49.716073 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c414df12-5f1f-4e1c-962d-306fa8e99be4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:49.716312 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d8d71211-6789-4f0d-9e54-f7c1d7a9355c tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:49.716757 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d8d71211-6789-4f0d-9e54-f7c1d7a9355c tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:49.717175 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c414df12-5f1f-4e1c-962d-306fa8e99be4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1406 microversion: 2.20 time: 0.254682 May 17 17:22:49.717537 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d8d71211-6789-4f0d-9e54-f7c1d7a9355c tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:49.717827 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 87/169] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:49 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:22:49.717979 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d8d71211-6789-4f0d-9e54-f7c1d7a9355c tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:49.850910 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d8d71211-6789-4f0d-9e54-f7c1d7a9355c tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:49.858155 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d8d71211-6789-4f0d-9e54-f7c1d7a9355c tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1315 microversion: 2.1 time: 0.151953 May 17 17:22:49.859066 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 83/170] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:49 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:22:49.886149 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-eb002121-f5a6-4f4d-befb-0099fd7b5bde tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:49.887191 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-eb002121-f5a6-4f4d-befb-0099fd7b5bde tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:49.893452 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eb002121-f5a6-4f4d-befb-0099fd7b5bde tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:49.893981 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eb002121-f5a6-4f4d-befb-0099fd7b5bde tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:49.894820 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eb002121-f5a6-4f4d-befb-0099fd7b5bde tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:49.895327 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eb002121-f5a6-4f4d-befb-0099fd7b5bde tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:50.049710 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-eb002121-f5a6-4f4d-befb-0099fd7b5bde tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:50.057487 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-eb002121-f5a6-4f4d-befb-0099fd7b5bde tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1322 microversion: 2.1 time: 0.175092 May 17 17:22:50.058059 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 88/171] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:49 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:50.662336 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-06413aed-bef7-45f5-b4c1-441b2396ef7d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:50.663028 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-06413aed-bef7-45f5-b4c1-441b2396ef7d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:50.669267 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-06413aed-bef7-45f5-b4c1-441b2396ef7d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:50.669895 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-06413aed-bef7-45f5-b4c1-441b2396ef7d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:50.670678 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-06413aed-bef7-45f5-b4c1-441b2396ef7d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:50.671142 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-06413aed-bef7-45f5-b4c1-441b2396ef7d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:50.737172 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-fcc89d27-23a3-4348-a2ff-5e742eaa83d0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:50.738423 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-fcc89d27-23a3-4348-a2ff-5e742eaa83d0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:50.755580 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fcc89d27-23a3-4348-a2ff-5e742eaa83d0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:50.755580 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fcc89d27-23a3-4348-a2ff-5e742eaa83d0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:50.755580 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fcc89d27-23a3-4348-a2ff-5e742eaa83d0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:50.755580 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fcc89d27-23a3-4348-a2ff-5e742eaa83d0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:50.993872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-fcc89d27-23a3-4348-a2ff-5e742eaa83d0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:51.001633 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-fcc89d27-23a3-4348-a2ff-5e742eaa83d0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:51.003820 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-fcc89d27-23a3-4348-a2ff-5e742eaa83d0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:51.005006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-fcc89d27-23a3-4348-a2ff-5e742eaa83d0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1406 microversion: 2.20 time: 0.273093 May 17 17:22:51.005890 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 89/172] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:50 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1406 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:22:51.011682 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7261da91-4c14-458c-8383-9366d314a6b1 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:51.012748 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-7261da91-4c14-458c-8383-9366d314a6b1 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:51.024011 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7261da91-4c14-458c-8383-9366d314a6b1 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:51.025386 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7261da91-4c14-458c-8383-9366d314a6b1 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:51.039161 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7261da91-4c14-458c-8383-9366d314a6b1 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:51.039161 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7261da91-4c14-458c-8383-9366d314a6b1 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:51.039677 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-06413aed-bef7-45f5-b4c1-441b2396ef7d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:51.040746 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-06413aed-bef7-45f5-b4c1-441b2396ef7d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1363 microversion: 2.1 time: 0.384079 May 17 17:22:51.041310 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 84/173] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:50 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1363 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:51.054888 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-6ed2300a-be33-4f69-a35b-426492f68104 req-d4fe3dab-9ab3-4171-8330-416ccfaf2a7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44", "name": "network-vif-plugged", "status": "completed", "tag": "88984695-6cd9-4b4c-b02c-9f8d26d785d7"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:22:51.072592 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-6ed2300a-be33-4f69-a35b-426492f68104 req-d4fe3dab-9ab3-4171-8330-416ccfaf2a7d service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:51.073062 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-6ed2300a-be33-4f69-a35b-426492f68104 req-d4fe3dab-9ab3-4171-8330-416ccfaf2a7d service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:51.090370 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-6ed2300a-be33-4f69-a35b-426492f68104 req-d4fe3dab-9ab3-4171-8330-416ccfaf2a7d service nova] Creating event network-vif-plugged:88984695-6cd9-4b4c-b02c-9f8d26d785d7 for instance bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 on hv-cinder-84214 May 17 17:22:51.100885 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-6ed2300a-be33-4f69-a35b-426492f68104 req-d4fe3dab-9ab3-4171-8330-416ccfaf2a7d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057993 May 17 17:22:51.101688 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 85/174] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:51.107767 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-697c328a-d239-42de-9827-c37cff6bd29e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:51.110087 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-697c328a-d239-42de-9827-c37cff6bd29e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:51.120189 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-697c328a-d239-42de-9827-c37cff6bd29e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:51.120872 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-697c328a-d239-42de-9827-c37cff6bd29e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:51.122702 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-697c328a-d239-42de-9827-c37cff6bd29e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:51.123286 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-697c328a-d239-42de-9827-c37cff6bd29e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:51.231018 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7261da91-4c14-458c-8383-9366d314a6b1 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:51.245541 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7261da91-4c14-458c-8383-9366d314a6b1 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1501 microversion: 2.1 time: 0.238415 May 17 17:22:51.249923 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 90/175] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:51 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1501 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:51.420950 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-697c328a-d239-42de-9827-c37cff6bd29e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:51.430886 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-697c328a-d239-42de-9827-c37cff6bd29e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1322 microversion: 2.1 time: 0.327464 May 17 17:22:51.432364 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 86/176] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:51 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:52.023422 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b4e5303e-2d9d-4fb0-ad8e-741aaf2a0a69 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:52.024092 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b4e5303e-2d9d-4fb0-ad8e-741aaf2a0a69 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:52.030552 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b4e5303e-2d9d-4fb0-ad8e-741aaf2a0a69 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:52.031000 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b4e5303e-2d9d-4fb0-ad8e-741aaf2a0a69 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:52.031873 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b4e5303e-2d9d-4fb0-ad8e-741aaf2a0a69 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:52.032225 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b4e5303e-2d9d-4fb0-ad8e-741aaf2a0a69 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:52.058751 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-56d80f34-3f7d-40bb-8a17-610b3441319f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:52.059830 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-56d80f34-3f7d-40bb-8a17-610b3441319f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:52.070931 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-56d80f34-3f7d-40bb-8a17-610b3441319f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:52.070931 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-56d80f34-3f7d-40bb-8a17-610b3441319f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:52.071278 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-56d80f34-3f7d-40bb-8a17-610b3441319f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:52.071749 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-56d80f34-3f7d-40bb-8a17-610b3441319f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:52.354796 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b4e5303e-2d9d-4fb0-ad8e-741aaf2a0a69 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:52.367290 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b4e5303e-2d9d-4fb0-ad8e-741aaf2a0a69 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:52.376010 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b4e5303e-2d9d-4fb0-ad8e-741aaf2a0a69 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:52.379896 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b4e5303e-2d9d-4fb0-ad8e-741aaf2a0a69 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1406 microversion: 2.20 time: 0.360173 May 17 17:22:52.380498 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 91/177] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:52 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1406 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:22:52.433449 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-56d80f34-3f7d-40bb-8a17-610b3441319f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:52.439390 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-56d80f34-3f7d-40bb-8a17-610b3441319f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1363 microversion: 2.1 time: 0.385272 May 17 17:22:52.440013 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 87/178] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:52 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1363 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:22:52.449126 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7e49f870-ebf8-4d2c-95c8-eab1f5b46383 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:52.449747 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-7e49f870-ebf8-4d2c-95c8-eab1f5b46383 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:52.456388 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7e49f870-ebf8-4d2c-95c8-eab1f5b46383 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:52.462170 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7e49f870-ebf8-4d2c-95c8-eab1f5b46383 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:52.462170 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7e49f870-ebf8-4d2c-95c8-eab1f5b46383 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:52.462170 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7e49f870-ebf8-4d2c-95c8-eab1f5b46383 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:52.651964 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7e49f870-ebf8-4d2c-95c8-eab1f5b46383 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:52.661195 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7e49f870-ebf8-4d2c-95c8-eab1f5b46383 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1322 microversion: 2.1 time: 0.215717 May 17 17:22:52.669016 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 92/179] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:52 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:53.245691 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-bc992e00-7837-43a7-bdb6-10a4d346c1ae tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3dce32b-a53e-4478-9516-f7143c7af301"}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:22:53.246825 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-bc992e00-7837-43a7-bdb6-10a4d346c1ae tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:53.252717 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bc992e00-7837-43a7-bdb6-10a4d346c1ae tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:53.253166 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bc992e00-7837-43a7-bdb6-10a4d346c1ae tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:53.253926 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bc992e00-7837-43a7-bdb6-10a4d346c1ae tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:53.254352 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bc992e00-7837-43a7-bdb6-10a4d346c1ae tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:53.398130 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-234306e8-1471-4e29-b8b6-0769a7ac76b3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:53.404466 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-234306e8-1471-4e29-b8b6-0769a7ac76b3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:53.412065 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-234306e8-1471-4e29-b8b6-0769a7ac76b3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:53.412594 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-234306e8-1471-4e29-b8b6-0769a7ac76b3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:53.415368 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-234306e8-1471-4e29-b8b6-0769a7ac76b3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:53.415368 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-234306e8-1471-4e29-b8b6-0769a7ac76b3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:53.574958 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-234306e8-1471-4e29-b8b6-0769a7ac76b3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:53.585758 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-234306e8-1471-4e29-b8b6-0769a7ac76b3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:53.587255 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-234306e8-1471-4e29-b8b6-0769a7ac76b3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:53.588538 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-234306e8-1471-4e29-b8b6-0769a7ac76b3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1406 microversion: 2.20 time: 0.194213 May 17 17:22:53.599715 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 93/180] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:53 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:22:53.605123 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6c00140a-8b7a-4563-b326-e60564f21c7a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:53.606034 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6c00140a-8b7a-4563-b326-e60564f21c7a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:53.612522 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6c00140a-8b7a-4563-b326-e60564f21c7a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:53.613185 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6c00140a-8b7a-4563-b326-e60564f21c7a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:53.614177 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6c00140a-8b7a-4563-b326-e60564f21c7a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:53.614703 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6c00140a-8b7a-4563-b326-e60564f21c7a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:53.758938 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6c00140a-8b7a-4563-b326-e60564f21c7a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:53.767839 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6c00140a-8b7a-4563-b326-e60564f21c7a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1549 microversion: 2.1 time: 0.166741 May 17 17:22:53.769999 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 94/181] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:53 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1549 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:53.783780 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f1cd3bc5-0929-4ff8-83d8-c63707994c6f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:53.783780 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f1cd3bc5-0929-4ff8-83d8-c63707994c6f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:53.792040 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f1cd3bc5-0929-4ff8-83d8-c63707994c6f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:53.792559 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f1cd3bc5-0929-4ff8-83d8-c63707994c6f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:53.793373 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f1cd3bc5-0929-4ff8-83d8-c63707994c6f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:53.793811 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f1cd3bc5-0929-4ff8-83d8-c63707994c6f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:53.932415 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f1cd3bc5-0929-4ff8-83d8-c63707994c6f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:53.947842 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f1cd3bc5-0929-4ff8-83d8-c63707994c6f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1322 microversion: 2.1 time: 0.169226 May 17 17:22:53.947842 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 95/182] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:53 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:53.947842 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-67c9cccc-fcb1-4de4-85f7-27383cffaa32 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:53.947842 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-67c9cccc-fcb1-4de4-85f7-27383cffaa32 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:53.951489 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-67c9cccc-fcb1-4de4-85f7-27383cffaa32 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:53.951981 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-67c9cccc-fcb1-4de4-85f7-27383cffaa32 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:53.952751 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-67c9cccc-fcb1-4de4-85f7-27383cffaa32 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:53.953243 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-67c9cccc-fcb1-4de4-85f7-27383cffaa32 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:54.070543 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-67c9cccc-fcb1-4de4-85f7-27383cffaa32 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128860 May 17 17:22:54.071842 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 96/183] 10.222.0.88 () {58 vars in 1274 bytes} [Tue May 17 17:22:53 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:54.606290 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-313cf78b-a674-43c5-9af4-2364dc43087a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:54.607683 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-313cf78b-a674-43c5-9af4-2364dc43087a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:54.613942 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-313cf78b-a674-43c5-9af4-2364dc43087a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:54.614791 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-313cf78b-a674-43c5-9af4-2364dc43087a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:54.615754 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-313cf78b-a674-43c5-9af4-2364dc43087a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:54.616339 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-313cf78b-a674-43c5-9af4-2364dc43087a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:54.834049 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-313cf78b-a674-43c5-9af4-2364dc43087a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:54.841967 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-313cf78b-a674-43c5-9af4-2364dc43087a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:54.848687 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-313cf78b-a674-43c5-9af4-2364dc43087a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:54.856107 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-313cf78b-a674-43c5-9af4-2364dc43087a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1406 microversion: 2.20 time: 0.247997 May 17 17:22:54.856107 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 97/184] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:54 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:22:54.961119 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-73855531-ae71-4333-8ec4-7f7f23643530 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:54.961985 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-73855531-ae71-4333-8ec4-7f7f23643530 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:54.970264 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-73855531-ae71-4333-8ec4-7f7f23643530 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:54.972050 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-73855531-ae71-4333-8ec4-7f7f23643530 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:54.973027 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-73855531-ae71-4333-8ec4-7f7f23643530 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:54.973645 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-73855531-ae71-4333-8ec4-7f7f23643530 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:55.150995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-73855531-ae71-4333-8ec4-7f7f23643530 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:55.161121 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-73855531-ae71-4333-8ec4-7f7f23643530 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1322 microversion: 2.1 time: 0.206033 May 17 17:22:55.162444 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 98/185] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:54 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:55.486281 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-0d22904a-ef42-44d7-878a-1dab72e79bba req-96b4c7a3-f6c3-4f9c-8f58-0ef5ae61a9a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a87018c-9e2f-4322-8472-dbe43085332f", "tag": "724c5ba3-c6a4-4624-8067-3660e3e44690"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:22:55.495041 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-0d22904a-ef42-44d7-878a-1dab72e79bba req-96b4c7a3-f6c3-4f9c-8f58-0ef5ae61a9a1 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:55.495478 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-0d22904a-ef42-44d7-878a-1dab72e79bba req-96b4c7a3-f6c3-4f9c-8f58-0ef5ae61a9a1 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:55.510182 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-0d22904a-ef42-44d7-878a-1dab72e79bba req-96b4c7a3-f6c3-4f9c-8f58-0ef5ae61a9a1 service nova] Creating event network-changed:724c5ba3-c6a4-4624-8067-3660e3e44690 for instance 3a87018c-9e2f-4322-8472-dbe43085332f on hv-cinder-84214 May 17 17:22:55.516350 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-0d22904a-ef42-44d7-878a-1dab72e79bba req-96b4c7a3-f6c3-4f9c-8f58-0ef5ae61a9a1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033697 May 17 17:22:55.517159 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 99/186] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:22:55.881945 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d7b57e53-dd82-4493-b928-3dd4426aa836 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:55.882651 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d7b57e53-dd82-4493-b928-3dd4426aa836 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:55.897989 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d7b57e53-dd82-4493-b928-3dd4426aa836 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:55.898457 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d7b57e53-dd82-4493-b928-3dd4426aa836 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:55.899625 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d7b57e53-dd82-4493-b928-3dd4426aa836 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:55.900769 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d7b57e53-dd82-4493-b928-3dd4426aa836 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:56.188977 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d7b57e53-dd82-4493-b928-3dd4426aa836 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:56.198835 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d7b57e53-dd82-4493-b928-3dd4426aa836 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:56.201210 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d7b57e53-dd82-4493-b928-3dd4426aa836 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:56.202583 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d7b57e53-dd82-4493-b928-3dd4426aa836 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1406 microversion: 2.20 time: 0.335088 May 17 17:22:56.203646 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 100/187] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:55 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1406 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:22:56.210788 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-14892b3d-8b98-4f5f-8177-dfac51516290 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:56.211690 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-14892b3d-8b98-4f5f-8177-dfac51516290 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:56.220039 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-14892b3d-8b98-4f5f-8177-dfac51516290 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:56.222313 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-14892b3d-8b98-4f5f-8177-dfac51516290 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:56.223475 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-14892b3d-8b98-4f5f-8177-dfac51516290 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:56.224144 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-14892b3d-8b98-4f5f-8177-dfac51516290 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:56.497424 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-14892b3d-8b98-4f5f-8177-dfac51516290 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:56.515864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-14892b3d-8b98-4f5f-8177-dfac51516290 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1322 microversion: 2.1 time: 0.311054 May 17 17:22:56.520332 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 101/188] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:56 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:56.530490 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-dc2143c5-9684-4f13-8e91-cd816e3ae0bd req-896a0cef-8899-4526-96b5-220b878238e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6849325b-2caa-4f21-945b-bff1e4f6b564", "name": "network-vif-plugged", "status": "completed", "tag": "8994f556-9e5d-412d-b043-6c3d04fc35e4"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:22:56.553257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-dc2143c5-9684-4f13-8e91-cd816e3ae0bd req-896a0cef-8899-4526-96b5-220b878238e2 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:56.556724 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-dc2143c5-9684-4f13-8e91-cd816e3ae0bd req-896a0cef-8899-4526-96b5-220b878238e2 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:56.586757 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-dc2143c5-9684-4f13-8e91-cd816e3ae0bd req-896a0cef-8899-4526-96b5-220b878238e2 service nova] Creating event network-vif-plugged:8994f556-9e5d-412d-b043-6c3d04fc35e4 for instance 6849325b-2caa-4f21-945b-bff1e4f6b564 on hv-cinder-84214 May 17 17:22:56.597836 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-dc2143c5-9684-4f13-8e91-cd816e3ae0bd req-896a0cef-8899-4526-96b5-220b878238e2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075828 May 17 17:22:56.598980 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 102/189] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:57.027467 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-274f6caa-301f-40b5-bf0f-e2b0401b990b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1180959313", "imageRef": "800c492c-ff69-4735-b2c9-a2dcaa20aa8d", "flavorRef": "452", "networks": [{"uuid": "a5c101a4-1fda-42e3-b2a2-b374c0d3a657"}]}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:22:57.104449 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.network.neutron [None req-274f6caa-301f-40b5-bf0f-e2b0401b990b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] validate_networks() for [('a5c101a4-1fda-42e3-b2a2-b374c0d3a657', None, None, None, None, None)] {{(pid=117612) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:22:57.338403 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-bc992e00-7837-43a7-bdb6-10a4d346c1ae tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "POST /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.096059 May 17 17:22:57.343846 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 88/190] 10.222.0.88 () {60 vars in 1322 bytes} [Tue May 17 17:22:53 2022] POST /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a/os-volume_attachments => generated 194 bytes in 4098 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:57.351751 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c29b153d-30ee-4a4c-8453-25a01fa8e611 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:57.351751 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c29b153d-30ee-4a4c-8453-25a01fa8e611 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:57.365502 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c29b153d-30ee-4a4c-8453-25a01fa8e611 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:57.366919 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c29b153d-30ee-4a4c-8453-25a01fa8e611 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:57.367860 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c29b153d-30ee-4a4c-8453-25a01fa8e611 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:57.368921 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c29b153d-30ee-4a4c-8453-25a01fa8e611 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:57.740721 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c29b153d-30ee-4a4c-8453-25a01fa8e611 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:57.740721 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c29b153d-30ee-4a4c-8453-25a01fa8e611 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:57.741080 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c29b153d-30ee-4a4c-8453-25a01fa8e611 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:57.741080 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c29b153d-30ee-4a4c-8453-25a01fa8e611 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1599 microversion: 2.20 time: 0.353823 May 17 17:22:57.741080 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 89/191] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:22:57 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1599 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:22:57.741080 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-29c0219b-8a42-4e1c-b1a2-a2f641e9e1c4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:57.741452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-29c0219b-8a42-4e1c-b1a2-a2f641e9e1c4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:57.741452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-29c0219b-8a42-4e1c-b1a2-a2f641e9e1c4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:57.741452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-29c0219b-8a42-4e1c-b1a2-a2f641e9e1c4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:57.741452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-29c0219b-8a42-4e1c-b1a2-a2f641e9e1c4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:57.741772 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-29c0219b-8a42-4e1c-b1a2-a2f641e9e1c4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:57.925056 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-274f6caa-301f-40b5-bf0f-e2b0401b990b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Flavor limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:22:57.926562 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-274f6caa-301f-40b5-bf0f-e2b0401b990b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Image limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:22:57.927049 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-274f6caa-301f-40b5-bf0f-e2b0401b990b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Flavor pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:22:57.927465 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-274f6caa-301f-40b5-bf0f-e2b0401b990b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Image pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:22:57.927924 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-274f6caa-301f-40b5-bf0f-e2b0401b990b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:22:57.928193 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-29c0219b-8a42-4e1c-b1a2-a2f641e9e1c4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:57.935242 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-29c0219b-8a42-4e1c-b1a2-a2f641e9e1c4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1322 microversion: 2.1 time: 0.238567 May 17 17:22:57.968672 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 90/192] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:57 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:57.970283 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-274f6caa-301f-40b5-bf0f-e2b0401b990b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:57.970283 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-274f6caa-301f-40b5-bf0f-e2b0401b990b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:57.970283 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-274f6caa-301f-40b5-bf0f-e2b0401b990b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:57.970283 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-274f6caa-301f-40b5-bf0f-e2b0401b990b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:57.971309 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-799bd1ee-7544-4817-8c62-ded02343e14e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:57.971309 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-799bd1ee-7544-4817-8c62-ded02343e14e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:57.971309 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-799bd1ee-7544-4817-8c62-ded02343e14e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:57.971309 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-799bd1ee-7544-4817-8c62-ded02343e14e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:57.971627 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-799bd1ee-7544-4817-8c62-ded02343e14e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:57.971627 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-799bd1ee-7544-4817-8c62-ded02343e14e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:57.971755 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-274f6caa-301f-40b5-bf0f-e2b0401b990b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Getting quotas for project 0f914985c201429e845986b973e37490. Resources: {'cores', 'ram', 'instances'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:22:57.971755 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-274f6caa-301f-40b5-bf0f-e2b0401b990b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Getting quotas for user 3dedebb1073a43109e45a3d73a8bc62f and project 0f914985c201429e845986b973e37490. Resources: {'cores', 'ram', 'instances'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:22:57.977625 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-274f6caa-301f-40b5-bf0f-e2b0401b990b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Going to run 1 instances... {{(pid=117612) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:22:57.979995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-274f6caa-301f-40b5-bf0f-e2b0401b990b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: c61bb514-0fba-4d7e-b461-b62de8d2c9c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='800c492c-ff69-4735-b2c9-a2dcaa20aa8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:22:58.035051 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-799bd1ee-7544-4817-8c62-ded02343e14e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.098159 May 17 17:22:58.035685 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 91/193] 10.222.0.88 () {60 vars in 1315 bytes} [Tue May 17 17:22:57 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 17:22:58.152153 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-274f6caa-301f-40b5-bf0f-e2b0401b990b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.129836 May 17 17:22:58.158685 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 103/194] 10.222.0.88 () {60 vars in 1146 bytes} [Tue May 17 17:22:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 17 17:22:58.169246 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4d12a748-ddbe-40c5-a965-a8b9c7458d7d tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:58.170191 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4d12a748-ddbe-40c5-a965-a8b9c7458d7d tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: c61bb514-0fba-4d7e-b461-b62de8d2c9c3] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:58.266568 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4d12a748-ddbe-40c5-a965-a8b9c7458d7d tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:58.274892 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4d12a748-ddbe-40c5-a965-a8b9c7458d7d tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3" status: 200 len: 1214 microversion: 2.1 time: 0.114918 May 17 17:22:58.278157 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 92/195] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:58 2022] GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3 => generated 1214 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:22:58.628131 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-1c42d9b6-d5f1-42ac-9829-8d002ab0ebb6 req-2ccd2a5a-72e7-4270-b8b9-dc68a0b3a144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ea4b9c8-340b-4cd6-abdd-419071fc0b0d", "name": "network-vif-plugged", "status": "completed", "tag": "f77db53d-6f2a-4604-ba2c-92c6f8dfd30b"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:22:58.676346 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-1c42d9b6-d5f1-42ac-9829-8d002ab0ebb6 req-2ccd2a5a-72e7-4270-b8b9-dc68a0b3a144 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:58.677426 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-1c42d9b6-d5f1-42ac-9829-8d002ab0ebb6 req-2ccd2a5a-72e7-4270-b8b9-dc68a0b3a144 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:58.704456 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-1c42d9b6-d5f1-42ac-9829-8d002ab0ebb6 req-2ccd2a5a-72e7-4270-b8b9-dc68a0b3a144 service nova] Creating event network-vif-plugged:f77db53d-6f2a-4604-ba2c-92c6f8dfd30b for instance 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d on hv-cinder-84214 May 17 17:22:58.712794 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-1c42d9b6-d5f1-42ac-9829-8d002ab0ebb6 req-2ccd2a5a-72e7-4270-b8b9-dc68a0b3a144 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088821 May 17 17:22:58.732006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 104/196] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:22:58.980184 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ad99c232-6d2e-4af2-acba-fa571a067ab8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:58.981044 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ad99c232-6d2e-4af2-acba-fa571a067ab8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:58.988721 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ad99c232-6d2e-4af2-acba-fa571a067ab8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:58.989178 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ad99c232-6d2e-4af2-acba-fa571a067ab8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:58.989991 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ad99c232-6d2e-4af2-acba-fa571a067ab8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:58.990408 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ad99c232-6d2e-4af2-acba-fa571a067ab8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:59.163271 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ad99c232-6d2e-4af2-acba-fa571a067ab8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:59.171352 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ad99c232-6d2e-4af2-acba-fa571a067ab8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1516 microversion: 2.1 time: 0.195263 May 17 17:22:59.172278 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 93/197] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:58 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1516 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:22:59.189626 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7bdf73c9-aac4-44c0-af09-b2cfbc64c91b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:22:59.193141 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-7bdf73c9-aac4-44c0-af09-b2cfbc64c91b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:59.198165 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7bdf73c9-aac4-44c0-af09-b2cfbc64c91b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:59.202876 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7bdf73c9-aac4-44c0-af09-b2cfbc64c91b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:59.203740 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7bdf73c9-aac4-44c0-af09-b2cfbc64c91b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:59.207598 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7bdf73c9-aac4-44c0-af09-b2cfbc64c91b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:59.238806 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-7bdf73c9-aac4-44c0-af09-b2cfbc64c91b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lazy-loading 'flavor' on Instance uuid 6849325b-2caa-4f21-945b-bff1e4f6b564 {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:22:59.295381 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-70743220-a151-44cf-9917-66fe82a0448c tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:59.296076 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-70743220-a151-44cf-9917-66fe82a0448c tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: c61bb514-0fba-4d7e-b461-b62de8d2c9c3] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:59.401726 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-70743220-a151-44cf-9917-66fe82a0448c tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:59.413384 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-70743220-a151-44cf-9917-66fe82a0448c tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3" status: 200 len: 1214 microversion: 2.1 time: 0.122288 May 17 17:22:59.414175 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 94/198] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:59 2022] GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3 => generated 1214 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:22:59.598244 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7bdf73c9-aac4-44c0-af09-b2cfbc64c91b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "POST /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564/action" status: 200 len: 32 microversion: 2.1 time: 0.405086 May 17 17:22:59.598244 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 105/199] 10.222.0.88 () {60 vars in 1277 bytes} [Tue May 17 17:22:59 2022] POST /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564/action => generated 32 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 17:22:59.602996 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-2803882d-0c2d-47d3-b4ac-16de6dbe9acc tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:22:59.603630 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-2803882d-0c2d-47d3-b4ac-16de6dbe9acc tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:22:59.610762 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2803882d-0c2d-47d3-b4ac-16de6dbe9acc tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:59.611610 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2803882d-0c2d-47d3-b4ac-16de6dbe9acc tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:59.612983 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2803882d-0c2d-47d3-b4ac-16de6dbe9acc tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:59.613857 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2803882d-0c2d-47d3-b4ac-16de6dbe9acc tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:59.877390 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-41f5831e-3f7b-4e6a-a452-be9544d74e77 req-69715429-f618-4d03-9ca3-8aa532cce455 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44", "tag": "88984695-6cd9-4b4c-b02c-9f8d26d785d7"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:22:59.896800 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-41f5831e-3f7b-4e6a-a452-be9544d74e77 req-69715429-f618-4d03-9ca3-8aa532cce455 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:22:59.897415 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-41f5831e-3f7b-4e6a-a452-be9544d74e77 req-69715429-f618-4d03-9ca3-8aa532cce455 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:22:59.932477 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2803882d-0c2d-47d3-b4ac-16de6dbe9acc tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:22:59.933145 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-41f5831e-3f7b-4e6a-a452-be9544d74e77 req-69715429-f618-4d03-9ca3-8aa532cce455 service nova] Creating event network-changed:88984695-6cd9-4b4c-b02c-9f8d26d785d7 for instance bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 on hv-cinder-84214 May 17 17:22:59.940618 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-41f5831e-3f7b-4e6a-a452-be9544d74e77 req-69715429-f618-4d03-9ca3-8aa532cce455 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067620 May 17 17:22:59.946584 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 106/200] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:22:59.960133 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-2803882d-0c2d-47d3-b4ac-16de6dbe9acc tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.363326 May 17 17:22:59.961516 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 95/201] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:22:59 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:00.430695 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-04a1b0f8-d204-48ed-942b-84aad10b3d40 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:00.431406 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-04a1b0f8-d204-48ed-942b-84aad10b3d40 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: c61bb514-0fba-4d7e-b461-b62de8d2c9c3] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:00.440675 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-04a1b0f8-d204-48ed-942b-84aad10b3d40 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:00.443743 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-04a1b0f8-d204-48ed-942b-84aad10b3d40 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:00.443743 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-04a1b0f8-d204-48ed-942b-84aad10b3d40 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:00.443743 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-04a1b0f8-d204-48ed-942b-84aad10b3d40 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:00.565528 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-04a1b0f8-d204-48ed-942b-84aad10b3d40 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:00.579116 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-04a1b0f8-d204-48ed-942b-84aad10b3d40 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3" status: 200 len: 1210 microversion: 2.1 time: 0.152549 May 17 17:23:00.581063 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 107/202] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:00 2022] GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3 => generated 1210 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:00.990394 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-84fd7710-87ea-4860-a39d-1db1310e21a4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:00.991551 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-84fd7710-87ea-4860-a39d-1db1310e21a4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:01.003464 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-84fd7710-87ea-4860-a39d-1db1310e21a4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:01.004274 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-84fd7710-87ea-4860-a39d-1db1310e21a4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:01.005295 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-84fd7710-87ea-4860-a39d-1db1310e21a4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:01.005919 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-84fd7710-87ea-4860-a39d-1db1310e21a4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:01.246407 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-84fd7710-87ea-4860-a39d-1db1310e21a4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:01.256113 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-84fd7710-87ea-4860-a39d-1db1310e21a4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.275517 May 17 17:23:01.258228 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 96/203] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:00 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:01.601893 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-46c4e509-5179-49fe-85f8-17e33c54dd9c tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:01.608070 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-46c4e509-5179-49fe-85f8-17e33c54dd9c tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: c61bb514-0fba-4d7e-b461-b62de8d2c9c3] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:01.620372 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-46c4e509-5179-49fe-85f8-17e33c54dd9c tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:01.620740 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-46c4e509-5179-49fe-85f8-17e33c54dd9c tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:01.621539 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-46c4e509-5179-49fe-85f8-17e33c54dd9c tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:01.621975 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-46c4e509-5179-49fe-85f8-17e33c54dd9c tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:01.922383 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-46c4e509-5179-49fe-85f8-17e33c54dd9c tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:01.934005 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-46c4e509-5179-49fe-85f8-17e33c54dd9c tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3" status: 200 len: 1266 microversion: 2.1 time: 0.339355 May 17 17:23:01.943575 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 108/204] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:01 2022] GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3 => generated 1266 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:02.274971 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-722b7bd8-22cf-4e68-8e1f-18901b65a87b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:02.275839 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-722b7bd8-22cf-4e68-8e1f-18901b65a87b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:02.283416 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-722b7bd8-22cf-4e68-8e1f-18901b65a87b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:02.283699 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-722b7bd8-22cf-4e68-8e1f-18901b65a87b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:02.284538 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-722b7bd8-22cf-4e68-8e1f-18901b65a87b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:02.285163 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-722b7bd8-22cf-4e68-8e1f-18901b65a87b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:02.421118 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-722b7bd8-22cf-4e68-8e1f-18901b65a87b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:02.438564 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-722b7bd8-22cf-4e68-8e1f-18901b65a87b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.163526 May 17 17:23:02.438564 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 97/205] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:02 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:02.954062 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-9eddb803-5794-4629-80cf-6b861465a0b5 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:02.955345 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-9eddb803-5794-4629-80cf-6b861465a0b5 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: c61bb514-0fba-4d7e-b461-b62de8d2c9c3] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:02.961584 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9eddb803-5794-4629-80cf-6b861465a0b5 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:02.962331 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9eddb803-5794-4629-80cf-6b861465a0b5 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:02.963351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9eddb803-5794-4629-80cf-6b861465a0b5 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:02.963836 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9eddb803-5794-4629-80cf-6b861465a0b5 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:03.128386 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-9eddb803-5794-4629-80cf-6b861465a0b5 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:03.137510 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-9eddb803-5794-4629-80cf-6b861465a0b5 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3" status: 200 len: 1314 microversion: 2.1 time: 0.188972 May 17 17:23:03.138092 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 109/206] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:02 2022] GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:03.453395 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3e8a83c6-fb2e-478d-bba1-058e1228eb9f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:03.454722 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3e8a83c6-fb2e-478d-bba1-058e1228eb9f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:03.461404 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3e8a83c6-fb2e-478d-bba1-058e1228eb9f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:03.461855 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3e8a83c6-fb2e-478d-bba1-058e1228eb9f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:03.462705 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3e8a83c6-fb2e-478d-bba1-058e1228eb9f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:03.463252 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3e8a83c6-fb2e-478d-bba1-058e1228eb9f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:03.604098 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3e8a83c6-fb2e-478d-bba1-058e1228eb9f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:03.614037 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3e8a83c6-fb2e-478d-bba1-058e1228eb9f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.164455 May 17 17:23:03.614834 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 98/207] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:03 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:04.044495 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-69c74d17-ac63-4081-b695-2df7e2a33f1c req-72b5fbbc-cf8b-4d15-a6ef-fc5ac3b7ae8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c61bb514-0fba-4d7e-b461-b62de8d2c9c3", "tag": "4fd9330b-e9ba-45cc-8c1d-1c66429a372a"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:23:04.054352 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-69c74d17-ac63-4081-b695-2df7e2a33f1c req-72b5fbbc-cf8b-4d15-a6ef-fc5ac3b7ae8e service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:04.054875 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-69c74d17-ac63-4081-b695-2df7e2a33f1c req-72b5fbbc-cf8b-4d15-a6ef-fc5ac3b7ae8e service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:04.066500 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-69c74d17-ac63-4081-b695-2df7e2a33f1c req-72b5fbbc-cf8b-4d15-a6ef-fc5ac3b7ae8e service nova] Creating event network-changed:4fd9330b-e9ba-45cc-8c1d-1c66429a372a for instance c61bb514-0fba-4d7e-b461-b62de8d2c9c3 on hv-cinder-84214 May 17 17:23:04.071395 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-69c74d17-ac63-4081-b695-2df7e2a33f1c req-72b5fbbc-cf8b-4d15-a6ef-fc5ac3b7ae8e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031735 May 17 17:23:04.072047 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 110/208] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:23:04.157053 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-de40cea7-99f0-488a-9ead-bea52aadc358 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:04.160000 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-de40cea7-99f0-488a-9ead-bea52aadc358 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: c61bb514-0fba-4d7e-b461-b62de8d2c9c3] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:04.168785 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-de40cea7-99f0-488a-9ead-bea52aadc358 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:04.169452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-de40cea7-99f0-488a-9ead-bea52aadc358 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:04.170534 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-de40cea7-99f0-488a-9ead-bea52aadc358 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:04.171099 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-de40cea7-99f0-488a-9ead-bea52aadc358 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:04.344699 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-de40cea7-99f0-488a-9ead-bea52aadc358 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:04.353108 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-de40cea7-99f0-488a-9ead-bea52aadc358 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3" status: 200 len: 1314 microversion: 2.1 time: 0.201658 May 17 17:23:04.353682 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 99/209] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:04 2022] GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:04.631252 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-14ae2243-fd40-49e4-a054-69b5906fd1f2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:04.632067 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-14ae2243-fd40-49e4-a054-69b5906fd1f2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:04.638918 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-14ae2243-fd40-49e4-a054-69b5906fd1f2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:04.640004 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-14ae2243-fd40-49e4-a054-69b5906fd1f2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:04.641113 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-14ae2243-fd40-49e4-a054-69b5906fd1f2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:04.641855 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-14ae2243-fd40-49e4-a054-69b5906fd1f2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:04.821011 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-14ae2243-fd40-49e4-a054-69b5906fd1f2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:04.828336 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-14ae2243-fd40-49e4-a054-69b5906fd1f2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.201704 May 17 17:23:04.828916 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 111/210] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:04 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:05.370159 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-aec5c39c-7b4b-47e4-9dd2-0b8b82f8863e tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:05.373707 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-aec5c39c-7b4b-47e4-9dd2-0b8b82f8863e tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: c61bb514-0fba-4d7e-b461-b62de8d2c9c3] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:05.378169 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-aec5c39c-7b4b-47e4-9dd2-0b8b82f8863e tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:05.378958 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-aec5c39c-7b4b-47e4-9dd2-0b8b82f8863e tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:05.379801 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-aec5c39c-7b4b-47e4-9dd2-0b8b82f8863e tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:05.380883 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-aec5c39c-7b4b-47e4-9dd2-0b8b82f8863e tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:05.597912 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-aec5c39c-7b4b-47e4-9dd2-0b8b82f8863e tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:05.615315 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-aec5c39c-7b4b-47e4-9dd2-0b8b82f8863e tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3" status: 200 len: 1314 microversion: 2.1 time: 0.245955 May 17 17:23:05.619734 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 100/211] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:05 2022] GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:05.846121 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-87a05cba-cb21-42d3-a436-432b93197ca8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:05.846739 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-87a05cba-cb21-42d3-a436-432b93197ca8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:05.858934 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-87a05cba-cb21-42d3-a436-432b93197ca8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:05.860046 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-87a05cba-cb21-42d3-a436-432b93197ca8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:05.861599 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-87a05cba-cb21-42d3-a436-432b93197ca8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:05.862047 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-87a05cba-cb21-42d3-a436-432b93197ca8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:06.065075 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-87a05cba-cb21-42d3-a436-432b93197ca8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:06.073074 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-87a05cba-cb21-42d3-a436-432b93197ca8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.231286 May 17 17:23:06.073644 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 112/212] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:05 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:06.639857 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-727efbb7-9717-4bb8-acd0-3b400237c331 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:06.641052 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-727efbb7-9717-4bb8-acd0-3b400237c331 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: c61bb514-0fba-4d7e-b461-b62de8d2c9c3] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:06.650015 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-727efbb7-9717-4bb8-acd0-3b400237c331 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:06.650724 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-727efbb7-9717-4bb8-acd0-3b400237c331 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:06.651706 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-727efbb7-9717-4bb8-acd0-3b400237c331 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:06.652294 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-727efbb7-9717-4bb8-acd0-3b400237c331 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:06.835032 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-727efbb7-9717-4bb8-acd0-3b400237c331 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:06.849232 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-727efbb7-9717-4bb8-acd0-3b400237c331 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3" status: 200 len: 1314 microversion: 2.1 time: 0.219082 May 17 17:23:06.851002 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 101/213] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:06 2022] GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:07.091587 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-76380a16-22a8-4ed0-bbb6-364301cc22e2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:07.092743 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-76380a16-22a8-4ed0-bbb6-364301cc22e2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:07.099441 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-76380a16-22a8-4ed0-bbb6-364301cc22e2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:07.099930 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-76380a16-22a8-4ed0-bbb6-364301cc22e2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:07.100707 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-76380a16-22a8-4ed0-bbb6-364301cc22e2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:07.101149 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-76380a16-22a8-4ed0-bbb6-364301cc22e2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:07.345703 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c27964ac-26cb-4b29-b8ee-c642beba1a2a tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:07.346214 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c27964ac-26cb-4b29-b8ee-c642beba1a2a tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:07.353175 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c27964ac-26cb-4b29-b8ee-c642beba1a2a tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:07.353715 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c27964ac-26cb-4b29-b8ee-c642beba1a2a tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:07.354680 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c27964ac-26cb-4b29-b8ee-c642beba1a2a tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:07.355140 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c27964ac-26cb-4b29-b8ee-c642beba1a2a tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:07.382757 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c27964ac-26cb-4b29-b8ee-c642beba1a2a tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Going to try to terminate instance {{(pid=117611) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:23:07.549346 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-76380a16-22a8-4ed0-bbb6-364301cc22e2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:07.557325 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-76380a16-22a8-4ed0-bbb6-364301cc22e2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.470714 May 17 17:23:07.557897 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 113/214] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:07 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:07.719987 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c27964ac-26cb-4b29-b8ee-c642beba1a2a tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "DELETE /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 204 len: 0 microversion: 2.1 time: 0.378588 May 17 17:23:07.721695 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 102/215] 10.222.0.88 () {58 vars in 1238 bytes} [Tue May 17 17:23:07 2022] DELETE /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:23:07.731614 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5ce3d93b-a140-4c51-847c-540e54e4764f tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:07.732473 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5ce3d93b-a140-4c51-847c-540e54e4764f tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:07.740140 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5ce3d93b-a140-4c51-847c-540e54e4764f tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:07.741101 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5ce3d93b-a140-4c51-847c-540e54e4764f tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:07.742044 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5ce3d93b-a140-4c51-847c-540e54e4764f tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:07.742634 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5ce3d93b-a140-4c51-847c-540e54e4764f tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:07.868645 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-11e2e10b-edd1-4272-9f2d-04e9747e6b8d tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:07.869354 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-11e2e10b-edd1-4272-9f2d-04e9747e6b8d tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: c61bb514-0fba-4d7e-b461-b62de8d2c9c3] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:07.885866 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-11e2e10b-edd1-4272-9f2d-04e9747e6b8d tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:07.885980 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-11e2e10b-edd1-4272-9f2d-04e9747e6b8d tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:07.887058 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-11e2e10b-edd1-4272-9f2d-04e9747e6b8d tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:07.888569 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-11e2e10b-edd1-4272-9f2d-04e9747e6b8d tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:07.925659 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5ce3d93b-a140-4c51-847c-540e54e4764f tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:07.942282 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5ce3d93b-a140-4c51-847c-540e54e4764f tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1553 microversion: 2.1 time: 0.215978 May 17 17:23:07.945141 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 114/216] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:07 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1553 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:08.113069 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-11e2e10b-edd1-4272-9f2d-04e9747e6b8d tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:08.123749 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-11e2e10b-edd1-4272-9f2d-04e9747e6b8d tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3" status: 200 len: 1314 microversion: 2.1 time: 0.260985 May 17 17:23:08.127725 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 103/217] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:07 2022] GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:23:08.575845 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ea5a1fc8-2f35-4113-ac2f-d2506857581c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:08.575845 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ea5a1fc8-2f35-4113-ac2f-d2506857581c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:08.584110 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ea5a1fc8-2f35-4113-ac2f-d2506857581c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:08.584110 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ea5a1fc8-2f35-4113-ac2f-d2506857581c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:08.584110 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ea5a1fc8-2f35-4113-ac2f-d2506857581c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:08.584110 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ea5a1fc8-2f35-4113-ac2f-d2506857581c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:08.819213 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ea5a1fc8-2f35-4113-ac2f-d2506857581c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:08.829025 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ea5a1fc8-2f35-4113-ac2f-d2506857581c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.258586 May 17 17:23:08.830365 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 115/218] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:08 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:08.969410 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b9497621-d709-48ab-8c59-da1a208c7d2f tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:08.975000 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b9497621-d709-48ab-8c59-da1a208c7d2f tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:08.980016 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b9497621-d709-48ab-8c59-da1a208c7d2f tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:08.980491 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b9497621-d709-48ab-8c59-da1a208c7d2f tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:08.981318 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b9497621-d709-48ab-8c59-da1a208c7d2f tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:08.981751 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b9497621-d709-48ab-8c59-da1a208c7d2f tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:09.143551 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e034fd93-3af2-43fd-90d4-bd40b55e1b44 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:09.146852 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e034fd93-3af2-43fd-90d4-bd40b55e1b44 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: c61bb514-0fba-4d7e-b461-b62de8d2c9c3] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:09.152771 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e034fd93-3af2-43fd-90d4-bd40b55e1b44 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:09.153293 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e034fd93-3af2-43fd-90d4-bd40b55e1b44 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:09.154760 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e034fd93-3af2-43fd-90d4-bd40b55e1b44 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:09.155376 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e034fd93-3af2-43fd-90d4-bd40b55e1b44 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:09.236606 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b9497621-d709-48ab-8c59-da1a208c7d2f tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:09.246121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b9497621-d709-48ab-8c59-da1a208c7d2f tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1553 microversion: 2.1 time: 0.280440 May 17 17:23:09.247547 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 104/219] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:08 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1553 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:09.386958 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e034fd93-3af2-43fd-90d4-bd40b55e1b44 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:09.396929 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e034fd93-3af2-43fd-90d4-bd40b55e1b44 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3" status: 200 len: 1314 microversion: 2.1 time: 0.258575 May 17 17:23:09.407382 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 116/220] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:09 2022] GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:23:09.847211 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-74dcc22b-7057-4f02-a52f-99793ba25ac7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:09.848096 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-74dcc22b-7057-4f02-a52f-99793ba25ac7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:09.854447 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-74dcc22b-7057-4f02-a52f-99793ba25ac7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:09.855344 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-74dcc22b-7057-4f02-a52f-99793ba25ac7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:09.856235 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-74dcc22b-7057-4f02-a52f-99793ba25ac7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:09.857107 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-74dcc22b-7057-4f02-a52f-99793ba25ac7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:10.011883 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-74dcc22b-7057-4f02-a52f-99793ba25ac7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:10.019792 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-74dcc22b-7057-4f02-a52f-99793ba25ac7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.177075 May 17 17:23:10.023028 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 105/221] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:09 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:10.265286 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-50c7cb85-e5eb-4525-b92b-5240c58b29b1 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:10.266629 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-50c7cb85-e5eb-4525-b92b-5240c58b29b1 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:10.273224 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-50c7cb85-e5eb-4525-b92b-5240c58b29b1 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:10.273694 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-50c7cb85-e5eb-4525-b92b-5240c58b29b1 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:10.274489 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-50c7cb85-e5eb-4525-b92b-5240c58b29b1 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:10.274926 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-50c7cb85-e5eb-4525-b92b-5240c58b29b1 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:10.414266 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d078619e-77b8-435a-9709-43dca126f680 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:10.415009 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d078619e-77b8-435a-9709-43dca126f680 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: c61bb514-0fba-4d7e-b461-b62de8d2c9c3] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:10.419343 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-50c7cb85-e5eb-4525-b92b-5240c58b29b1 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:10.421232 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d078619e-77b8-435a-9709-43dca126f680 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:10.421750 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d078619e-77b8-435a-9709-43dca126f680 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:10.422600 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d078619e-77b8-435a-9709-43dca126f680 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:10.423738 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d078619e-77b8-435a-9709-43dca126f680 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:10.427756 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-50c7cb85-e5eb-4525-b92b-5240c58b29b1 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1553 microversion: 2.1 time: 0.167851 May 17 17:23:10.428227 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 117/222] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:10 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:10.597017 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d078619e-77b8-435a-9709-43dca126f680 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:10.605852 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d078619e-77b8-435a-9709-43dca126f680 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3" status: 200 len: 1314 microversion: 2.1 time: 0.195513 May 17 17:23:10.606835 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 106/223] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:10 2022] GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:11.040964 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-bde15ed7-894e-4eee-bef3-ef2f189e6af4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:11.042002 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-bde15ed7-894e-4eee-bef3-ef2f189e6af4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:11.048489 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bde15ed7-894e-4eee-bef3-ef2f189e6af4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:11.049041 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bde15ed7-894e-4eee-bef3-ef2f189e6af4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:11.049983 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bde15ed7-894e-4eee-bef3-ef2f189e6af4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:11.050489 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bde15ed7-894e-4eee-bef3-ef2f189e6af4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:11.265644 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-bde15ed7-894e-4eee-bef3-ef2f189e6af4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:11.283477 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-bde15ed7-894e-4eee-bef3-ef2f189e6af4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.239741 May 17 17:23:11.283477 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 118/224] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:11 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:11.454275 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-55462397-80d8-467b-a4ce-34d318e17917 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:11.455676 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-55462397-80d8-467b-a4ce-34d318e17917 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:11.463458 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-55462397-80d8-467b-a4ce-34d318e17917 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:11.463951 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-55462397-80d8-467b-a4ce-34d318e17917 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:11.464736 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-55462397-80d8-467b-a4ce-34d318e17917 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:11.465362 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-55462397-80d8-467b-a4ce-34d318e17917 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:11.605898 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-55462397-80d8-467b-a4ce-34d318e17917 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:11.614302 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-55462397-80d8-467b-a4ce-34d318e17917 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1553 microversion: 2.1 time: 0.172189 May 17 17:23:11.620026 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 107/225] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:11 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:11.627738 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-16772dd9-dc7c-4b18-bae4-fbcbf6f5ea67 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:11.628607 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-16772dd9-dc7c-4b18-bae4-fbcbf6f5ea67 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: c61bb514-0fba-4d7e-b461-b62de8d2c9c3] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:11.635208 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-16772dd9-dc7c-4b18-bae4-fbcbf6f5ea67 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:11.635699 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-16772dd9-dc7c-4b18-bae4-fbcbf6f5ea67 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:11.636492 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-16772dd9-dc7c-4b18-bae4-fbcbf6f5ea67 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:11.637114 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-16772dd9-dc7c-4b18-bae4-fbcbf6f5ea67 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:11.807133 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-16772dd9-dc7c-4b18-bae4-fbcbf6f5ea67 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:11.816069 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-16772dd9-dc7c-4b18-bae4-fbcbf6f5ea67 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3" status: 200 len: 1314 microversion: 2.1 time: 0.195919 May 17 17:23:11.825227 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 119/226] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:11 2022] GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:12.292100 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-731bc8d9-6530-4762-a071-9fe2eba1b2dc tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:12.292842 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-731bc8d9-6530-4762-a071-9fe2eba1b2dc tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:12.299573 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-731bc8d9-6530-4762-a071-9fe2eba1b2dc tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:12.300066 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-731bc8d9-6530-4762-a071-9fe2eba1b2dc tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:12.301322 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-731bc8d9-6530-4762-a071-9fe2eba1b2dc tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:12.301584 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-731bc8d9-6530-4762-a071-9fe2eba1b2dc tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:12.624924 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-731bc8d9-6530-4762-a071-9fe2eba1b2dc tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:12.632332 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-731bc8d9-6530-4762-a071-9fe2eba1b2dc tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.344193 May 17 17:23:12.639827 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 108/227] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:12 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:12.652645 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d0ca7d0e-e291-429b-9cc6-17cd832c4aed tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:12.655160 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d0ca7d0e-e291-429b-9cc6-17cd832c4aed tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:12.666518 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d0ca7d0e-e291-429b-9cc6-17cd832c4aed tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:12.667360 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d0ca7d0e-e291-429b-9cc6-17cd832c4aed tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:12.668651 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d0ca7d0e-e291-429b-9cc6-17cd832c4aed tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:12.669361 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d0ca7d0e-e291-429b-9cc6-17cd832c4aed tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:12.676622 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-c345d987-09f1-4ee6-b59f-af55e778243e req-25efc3b7-4cd4-4322-b454-b1b41114bfc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "086aec45-2c47-4b06-9fc9-a19c44a3673a", "name": "network-vif-deleted", "tag": "cd951b9f-179e-4c54-9050-7b2c81ed2b23"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:23:12.698097 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-c345d987-09f1-4ee6-b59f-af55e778243e req-25efc3b7-4cd4-4322-b454-b1b41114bfc0 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:12.698700 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-c345d987-09f1-4ee6-b59f-af55e778243e req-25efc3b7-4cd4-4322-b454-b1b41114bfc0 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:12.720747 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-c345d987-09f1-4ee6-b59f-af55e778243e req-25efc3b7-4cd4-4322-b454-b1b41114bfc0 service nova] Creating event network-vif-deleted:cd951b9f-179e-4c54-9050-7b2c81ed2b23 for instance 086aec45-2c47-4b06-9fc9-a19c44a3673a on hv-cinder-84214 May 17 17:23:12.726342 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-c345d987-09f1-4ee6-b59f-af55e778243e req-25efc3b7-4cd4-4322-b454-b1b41114bfc0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053546 May 17 17:23:12.727559 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 109/228] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:23:12.803371 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d0ca7d0e-e291-429b-9cc6-17cd832c4aed tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:12.816692 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d0ca7d0e-e291-429b-9cc6-17cd832c4aed tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1511 microversion: 2.1 time: 0.188579 May 17 17:23:12.817771 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 120/229] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:12 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1511 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:12.834625 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f27b04d6-8438-4ae9-8d64-41e7969bc657 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:12.835487 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f27b04d6-8438-4ae9-8d64-41e7969bc657 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: c61bb514-0fba-4d7e-b461-b62de8d2c9c3] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:12.841754 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f27b04d6-8438-4ae9-8d64-41e7969bc657 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:12.842205 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f27b04d6-8438-4ae9-8d64-41e7969bc657 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:12.842974 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f27b04d6-8438-4ae9-8d64-41e7969bc657 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:12.843407 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f27b04d6-8438-4ae9-8d64-41e7969bc657 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:13.115341 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f27b04d6-8438-4ae9-8d64-41e7969bc657 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:13.123780 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f27b04d6-8438-4ae9-8d64-41e7969bc657 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3" status: 200 len: 1314 microversion: 2.1 time: 0.293249 May 17 17:23:13.128006 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 110/230] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:12 2022] GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:13.578832 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-dfbdf496-eac0-4bd7-8ffa-eefaf64b79b2 req-9c4f4bba-e9af-4da4-b601-aac3aa3e8c4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c61bb514-0fba-4d7e-b461-b62de8d2c9c3", "name": "network-vif-plugged", "status": "completed", "tag": "4fd9330b-e9ba-45cc-8c1d-1c66429a372a"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:23:13.590786 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-dfbdf496-eac0-4bd7-8ffa-eefaf64b79b2 req-9c4f4bba-e9af-4da4-b601-aac3aa3e8c4e service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:13.591236 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-dfbdf496-eac0-4bd7-8ffa-eefaf64b79b2 req-9c4f4bba-e9af-4da4-b601-aac3aa3e8c4e service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:13.654634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-56282f3c-1998-4e38-8792-c5b0e67f9c71 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:13.664543 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-56282f3c-1998-4e38-8792-c5b0e67f9c71 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:13.665113 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-dfbdf496-eac0-4bd7-8ffa-eefaf64b79b2 req-9c4f4bba-e9af-4da4-b601-aac3aa3e8c4e service nova] Creating event network-vif-plugged:4fd9330b-e9ba-45cc-8c1d-1c66429a372a for instance c61bb514-0fba-4d7e-b461-b62de8d2c9c3 on hv-cinder-84214 May 17 17:23:13.702149 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-56282f3c-1998-4e38-8792-c5b0e67f9c71 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:13.707380 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-56282f3c-1998-4e38-8792-c5b0e67f9c71 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:13.718715 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-dfbdf496-eac0-4bd7-8ffa-eefaf64b79b2 req-9c4f4bba-e9af-4da4-b601-aac3aa3e8c4e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139647 May 17 17:23:13.721691 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-56282f3c-1998-4e38-8792-c5b0e67f9c71 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:13.721825 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 121/231] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:23:13.722370 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-56282f3c-1998-4e38-8792-c5b0e67f9c71 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:13.839390 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0d9c8f35-ded2-4a77-aed6-72f378259ae3 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:13.840470 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0d9c8f35-ded2-4a77-aed6-72f378259ae3 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:13.855083 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0d9c8f35-ded2-4a77-aed6-72f378259ae3 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:13.856006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0d9c8f35-ded2-4a77-aed6-72f378259ae3 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:13.857414 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0d9c8f35-ded2-4a77-aed6-72f378259ae3 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:13.861927 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0d9c8f35-ded2-4a77-aed6-72f378259ae3 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:13.936916 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0d9c8f35-ded2-4a77-aed6-72f378259ae3 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:13.937301 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0d9c8f35-ded2-4a77-aed6-72f378259ae3 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:13.937760 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-0d9c8f35-ded2-4a77-aed6-72f378259ae3 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lazy-loading 'fault' on Instance uuid 086aec45-2c47-4b06-9fc9-a19c44a3673a {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:23:14.036260 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0d9c8f35-ded2-4a77-aed6-72f378259ae3 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98dc9781e62d471eb8705ef299b5693a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3052d0bf74405e8b7c964561163e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:14.060481 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0d9c8f35-ded2-4a77-aed6-72f378259ae3 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 200 len: 1351 microversion: 2.1 time: 0.228699 May 17 17:23:14.071608 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 122/232] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:13 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 1351 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:14.120884 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-56282f3c-1998-4e38-8792-c5b0e67f9c71 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:14.134969 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-56282f3c-1998-4e38-8792-c5b0e67f9c71 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.484341 May 17 17:23:14.135904 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 111/233] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:13 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:14.149787 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-22ea32fa-a6c7-49c2-a55f-327646eba9e6 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:14.150407 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-22ea32fa-a6c7-49c2-a55f-327646eba9e6 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: c61bb514-0fba-4d7e-b461-b62de8d2c9c3] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:14.160922 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-22ea32fa-a6c7-49c2-a55f-327646eba9e6 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:14.161693 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-22ea32fa-a6c7-49c2-a55f-327646eba9e6 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:14.165961 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-22ea32fa-a6c7-49c2-a55f-327646eba9e6 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:14.166481 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-22ea32fa-a6c7-49c2-a55f-327646eba9e6 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:14.426123 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-22ea32fa-a6c7-49c2-a55f-327646eba9e6 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:14.434477 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-22ea32fa-a6c7-49c2-a55f-327646eba9e6 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3" status: 200 len: 1314 microversion: 2.1 time: 0.294278 May 17 17:23:14.444255 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 123/234] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:14 2022] GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:15.077810 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e180f7bf-ce03-4027-91a9-b86df62a734b tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:15.078423 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e180f7bf-ce03-4027-91a9-b86df62a734b tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:15.093346 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e180f7bf-ce03-4027-91a9-b86df62a734b tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:15.093346 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e180f7bf-ce03-4027-91a9-b86df62a734b tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:15.094038 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e180f7bf-ce03-4027-91a9-b86df62a734b tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:15.094523 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e180f7bf-ce03-4027-91a9-b86df62a734b tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:15.116676 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-e180f7bf-ce03-4027-91a9-b86df62a734b tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] HTTP exception thrown: Instance 086aec45-2c47-4b06-9fc9-a19c44a3673a could not be found. May 17 17:23:15.125121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e180f7bf-ce03-4027-91a9-b86df62a734b tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Request method failure captured: May 17 17:23:15.125121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a HTTP/1.1 May 17 17:23:15.125121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:23:15.125121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:23:15.125121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:23:15.125121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:23:15.125121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:23:15.125121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:23:15.125121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:23:15.125121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:23:15.125121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9m3QzaSGB4UOdaHEp9yD5rewgfNZ9wvX4aMQXgKovLYyXBnMOLsXmeM6uA9ovaBMXo9eZQUCk4GosCn0KzVJS0bJcy1eD3_jf1gZ87g5FAacukcS7TYIH_CTsgnvuC-YpRAx6v2N9kt00D6eUBsRPCiLoux7allIX3XxjwaWDE6yZo May 17 17:23:15.125121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:23:15.125121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:23:15.125121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:23:15.125121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:23:15.125121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:23:15.125121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:23:15.125121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: 7e3052d0bf74405e8b7c964561163e6f May 17 17:23:15.125121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-DeleteServersTestJSON-105238966 May 17 17:23:15.125121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:23:15.125121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:23:15.126438 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7e3052d0bf74405e8b7c964561163e6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/7e3052d0bf74405e8b7c964561163e6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7e3052d0bf74405e8b7c964561163e6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_7e3052d0bf74405e8b7c964561163e6f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:23:15.126438 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-DeleteServersTestJSON-105238966 May 17 17:23:15.126438 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: 7e3052d0bf74405e8b7c964561163e6f May 17 17:23:15.126438 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-DeleteServersTestJSON-105238966 May 17 17:23:15.126438 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-DeleteServersTestJSON-105238966-project May 17 17:23:15.126438 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:23:15.126438 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:23:15.126438 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 98dc9781e62d471eb8705ef299b5693a May 17 17:23:15.126438 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-DeleteServersTestJSON-105238966-project May 17 17:23:15.126438 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:23:15.126438 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Instance 086aec45-2c47-4b06-9fc9-a19c44a3673a could not be found. May 17 17:23:15.126438 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': '086aec45-2c47-4b06-9fc9-a19c44a3673a'} May 17 17:23:15.127147 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:23:15.127147 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:23:15.127147 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:23:15.127147 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:23:15.127147 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:23:15.127147 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:23:15.127147 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:23:15.127147 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:23:15.127147 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:23:15.127147 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:23:15.127147 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 086aec45-2c47-4b06-9fc9-a19c44a3673a could not be found. May 17 17:23:15.127147 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:23:15.127147 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:23:15.127147 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:23:15.127147 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:23:15.127147 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:23:15.127147 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:23:15.127147 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:23:15.127147 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:23:15.127147 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:23:15.128325 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:23:15.128325 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:23:15.128325 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:23:15.128325 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:23:15.128325 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:23:15.128325 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:23:15.128325 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:23:15.128325 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 086aec45-2c47-4b06-9fc9-a19c44a3673a could not be found. May 17 17:23:15.128325 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:23:15.128325 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:23:15.128325 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:23:15.128325 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:23:15.128325 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:23:15.128325 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:23:15.128325 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:23:15.128325 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:23:15.128325 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 086aec45-2c47-4b06-9fc9-a19c44a3673a could not be found. May 17 17:23:15.128325 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:23:15.129361 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e180f7bf-ce03-4027-91a9-b86df62a734b tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Returning 404 to user: Instance 086aec45-2c47-4b06-9fc9-a19c44a3673a could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:23:15.129361 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e180f7bf-ce03-4027-91a9-b86df62a734b tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 404 len: 111 microversion: 2.1 time: 0.052990 May 17 17:23:15.130987 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 112/235] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:15 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:23:15.152740 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c06f58c8-523c-43aa-b69a-bbab1287023c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:15.153298 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c06f58c8-523c-43aa-b69a-bbab1287023c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:15.169459 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c06f58c8-523c-43aa-b69a-bbab1287023c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:15.169927 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c06f58c8-523c-43aa-b69a-bbab1287023c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:15.170738 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c06f58c8-523c-43aa-b69a-bbab1287023c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:15.171178 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c06f58c8-523c-43aa-b69a-bbab1287023c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:15.317276 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-bf721785-ad42-43b6-9ce4-bf7a7eba22d0 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:15.318415 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-bf721785-ad42-43b6-9ce4-bf7a7eba22d0 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:15.329573 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bf721785-ad42-43b6-9ce4-bf7a7eba22d0 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:15.334722 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bf721785-ad42-43b6-9ce4-bf7a7eba22d0 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:15.335489 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bf721785-ad42-43b6-9ce4-bf7a7eba22d0 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:15.335967 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bf721785-ad42-43b6-9ce4-bf7a7eba22d0 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:15.364480 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-bf721785-ad42-43b6-9ce4-bf7a7eba22d0 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] HTTP exception thrown: Instance 086aec45-2c47-4b06-9fc9-a19c44a3673a could not be found. May 17 17:23:15.366498 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-bf721785-ad42-43b6-9ce4-bf7a7eba22d0 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Request method failure captured: May 17 17:23:15.366498 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a/os-volume_attachments HTTP/1.1 May 17 17:23:15.366498 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:23:15.366498 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:23:15.366498 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:23:15.366498 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:23:15.366498 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:23:15.366498 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:23:15.366498 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:23:15.366498 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:23:15.366498 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9m3QzaSGB4UOdaHEp9yD5rewgfNZ9wvX4aMQXgKovLYyXBnMOLsXmeM6uA9ovaBMXo9eZQUCk4GosCn0KzVJS0bJcy1eD3_jf1gZ87g5FAacukcS7TYIH_CTsgnvuC-YpRAx6v2N9kt00D6eUBsRPCiLoux7allIX3XxjwaWDE6yZo May 17 17:23:15.366498 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:23:15.366498 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:23:15.366498 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:23:15.366498 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:23:15.366498 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:23:15.366498 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:23:15.366498 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: 7e3052d0bf74405e8b7c964561163e6f May 17 17:23:15.366498 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-DeleteServersTestJSON-105238966 May 17 17:23:15.366498 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:23:15.366498 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:23:15.367752 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7e3052d0bf74405e8b7c964561163e6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/7e3052d0bf74405e8b7c964561163e6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7e3052d0bf74405e8b7c964561163e6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_7e3052d0bf74405e8b7c964561163e6f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:23:15.367752 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-DeleteServersTestJSON-105238966 May 17 17:23:15.367752 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: 7e3052d0bf74405e8b7c964561163e6f May 17 17:23:15.367752 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-DeleteServersTestJSON-105238966 May 17 17:23:15.367752 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-DeleteServersTestJSON-105238966-project May 17 17:23:15.367752 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:23:15.367752 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:23:15.367752 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 98dc9781e62d471eb8705ef299b5693a May 17 17:23:15.367752 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-DeleteServersTestJSON-105238966-project May 17 17:23:15.367752 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:23:15.367752 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Instance 086aec45-2c47-4b06-9fc9-a19c44a3673a could not be found. May 17 17:23:15.367752 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'server_id': '086aec45-2c47-4b06-9fc9-a19c44a3673a'} May 17 17:23:15.368437 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:23:15.368437 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:23:15.368437 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:23:15.368437 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:23:15.368437 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:23:15.368437 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:23:15.368437 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:23:15.368437 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:23:15.368437 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:23:15.368437 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:23:15.368437 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 086aec45-2c47-4b06-9fc9-a19c44a3673a could not be found. May 17 17:23:15.368437 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:23:15.368437 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:23:15.368437 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:23:15.368437 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:23:15.368437 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:23:15.368437 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:23:15.368437 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:23:15.368437 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:23:15.368437 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:23:15.369536 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:23:15.369536 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 17 17:23:15.369536 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 17:23:15.369536 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 17 17:23:15.369536 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 17:23:15.369536 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 17 17:23:15.369536 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 17 17:23:15.369536 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:23:15.369536 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:23:15.369536 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 086aec45-2c47-4b06-9fc9-a19c44a3673a could not be found. May 17 17:23:15.369536 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:23:15.369536 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:23:15.369536 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:23:15.369536 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:23:15.369536 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:23:15.369536 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:23:15.369536 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:23:15.369536 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:23:15.369536 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 086aec45-2c47-4b06-9fc9-a19c44a3673a could not be found. May 17 17:23:15.369536 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:23:15.370586 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-bf721785-ad42-43b6-9ce4-bf7a7eba22d0 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Returning 404 to user: Instance 086aec45-2c47-4b06-9fc9-a19c44a3673a could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:23:15.372374 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-bf721785-ad42-43b6-9ce4-bf7a7eba22d0 tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.060819 May 17 17:23:15.378033 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 113/236] 10.222.0.88 () {58 vars in 1301 bytes} [Tue May 17 17:23:15 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a/os-volume_attachments => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:23:15.454719 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-55ea2ca3-4fbd-4583-a927-68af0b0cc0b6 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:15.455329 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-55ea2ca3-4fbd-4583-a927-68af0b0cc0b6 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: c61bb514-0fba-4d7e-b461-b62de8d2c9c3] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:15.467855 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-55ea2ca3-4fbd-4583-a927-68af0b0cc0b6 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:15.473235 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-55ea2ca3-4fbd-4583-a927-68af0b0cc0b6 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:15.474481 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-55ea2ca3-4fbd-4583-a927-68af0b0cc0b6 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:15.475095 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-55ea2ca3-4fbd-4583-a927-68af0b0cc0b6 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:15.724276 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c06f58c8-523c-43aa-b69a-bbab1287023c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:15.736009 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c06f58c8-523c-43aa-b69a-bbab1287023c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.586522 May 17 17:23:15.745779 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 124/237] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:15 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:15.815328 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-55ea2ca3-4fbd-4583-a927-68af0b0cc0b6 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:15.827928 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-55ea2ca3-4fbd-4583-a927-68af0b0cc0b6 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3" status: 200 len: 1314 microversion: 2.1 time: 0.377409 May 17 17:23:15.829554 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 114/238] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:15 2022] GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:16.753520 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ffcbd036-94b4-4741-ab17-b65e89c08cff tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:16.754140 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ffcbd036-94b4-4741-ab17-b65e89c08cff tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:16.760428 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ffcbd036-94b4-4741-ab17-b65e89c08cff tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:16.761155 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ffcbd036-94b4-4741-ab17-b65e89c08cff tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:16.764654 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ffcbd036-94b4-4741-ab17-b65e89c08cff tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:16.771397 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ffcbd036-94b4-4741-ab17-b65e89c08cff tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:16.845685 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3fedf175-e395-4b5f-ae08-4ab1db83331f tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:16.846453 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3fedf175-e395-4b5f-ae08-4ab1db83331f tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: c61bb514-0fba-4d7e-b461-b62de8d2c9c3] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:16.859256 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3fedf175-e395-4b5f-ae08-4ab1db83331f tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:16.861687 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3fedf175-e395-4b5f-ae08-4ab1db83331f tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:16.861687 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3fedf175-e395-4b5f-ae08-4ab1db83331f tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:16.861687 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3fedf175-e395-4b5f-ae08-4ab1db83331f tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:17.187161 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ffcbd036-94b4-4741-ab17-b65e89c08cff tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:17.201226 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ffcbd036-94b4-4741-ab17-b65e89c08cff tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.448154 May 17 17:23:17.201226 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 125/239] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:16 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:17.202186 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e0b3dd3b-cdbb-4aa4-b67c-2de02383aa0c tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:17.203025 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e0b3dd3b-cdbb-4aa4-b67c-2de02383aa0c tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:17.209928 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e0b3dd3b-cdbb-4aa4-b67c-2de02383aa0c tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:17.210369 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e0b3dd3b-cdbb-4aa4-b67c-2de02383aa0c tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:17.211146 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e0b3dd3b-cdbb-4aa4-b67c-2de02383aa0c tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:17.211612 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e0b3dd3b-cdbb-4aa4-b67c-2de02383aa0c tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:17.243727 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3fedf175-e395-4b5f-ae08-4ab1db83331f tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:17.252171 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3fedf175-e395-4b5f-ae08-4ab1db83331f tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3" status: 200 len: 1498 microversion: 2.1 time: 0.411442 May 17 17:23:17.253214 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 115/240] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:16 2022] GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3 => generated 1498 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:17.380896 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-e0b3dd3b-cdbb-4aa4-b67c-2de02383aa0c tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] HTTP exception thrown: Instance 086aec45-2c47-4b06-9fc9-a19c44a3673a could not be found. May 17 17:23:17.385640 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e0b3dd3b-cdbb-4aa4-b67c-2de02383aa0c tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Request method failure captured: May 17 17:23:17.385640 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: request: DELETE /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a HTTP/1.1 May 17 17:23:17.385640 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 17 17:23:17.385640 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 17 17:23:17.385640 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Connection: close May 17 17:23:17.385640 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 17 17:23:17.385640 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 17 17:23:17.385640 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.88 May 17 17:23:17.385640 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 17 17:23:17.385640 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 17 17:23:17.385640 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABig9m3QzaSGB4UOdaHEp9yD5rewgfNZ9wvX4aMQXgKovLYyXBnMOLsXmeM6uA9ovaBMXo9eZQUCk4GosCn0KzVJS0bJcy1eD3_jf1gZ87g5FAacukcS7TYIH_CTsgnvuC-YpRAx6v2N9kt00D6eUBsRPCiLoux7allIX3XxjwaWDE6yZo May 17 17:23:17.385640 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 17 17:23:17.385640 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 17 17:23:17.385640 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 17 17:23:17.385640 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 17 17:23:17.385640 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 17 17:23:17.385640 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 17 17:23:17.385640 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 7e3052d0bf74405e8b7c964561163e6f May 17 17:23:17.385640 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-DeleteServersTestJSON-105238966 May 17 17:23:17.385640 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Role: reader,member May 17 17:23:17.385640 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Roles: reader,member May 17 17:23:17.387257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7e3052d0bf74405e8b7c964561163e6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/7e3052d0bf74405e8b7c964561163e6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7e3052d0bf74405e8b7c964561163e6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_7e3052d0bf74405e8b7c964561163e6f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:23:17.387257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-DeleteServersTestJSON-105238966 May 17 17:23:17.387257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 7e3052d0bf74405e8b7c964561163e6f May 17 17:23:17.387257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-DeleteServersTestJSON-105238966 May 17 17:23:17.387257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User: tempest-DeleteServersTestJSON-105238966-project May 17 17:23:17.387257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 17 17:23:17.387257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 17 17:23:17.387257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Id: 98dc9781e62d471eb8705ef299b5693a May 17 17:23:17.387257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-DeleteServersTestJSON-105238966-project May 17 17:23:17.387257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: method: > May 17 17:23:17.387257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: exception: Instance 086aec45-2c47-4b06-9fc9-a19c44a3673a could not be found. May 17 17:23:17.387257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: action_args: {'id': '086aec45-2c47-4b06-9fc9-a19c44a3673a'} May 17 17:23:17.390995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:23:17.390995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:23:17.390995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:23:17.390995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:23:17.390995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:23:17.390995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:23:17.390995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:23:17.390995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:23:17.390995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:23:17.390995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:23:17.390995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 086aec45-2c47-4b06-9fc9-a19c44a3673a could not be found. May 17 17:23:17.390995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:23:17.390995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:23:17.390995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:23:17.390995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:23:17.390995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:23:17.390995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:23:17.390995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:23:17.390995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:23:17.390995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:23:17.393257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:23:17.393257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 17:23:17.393257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 17:23:17.393257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 17:23:17.393257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 17:23:17.393257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:23:17.393257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:23:17.393257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:23:17.393257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:23:17.393257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 086aec45-2c47-4b06-9fc9-a19c44a3673a could not be found. May 17 17:23:17.393257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:23:17.393257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:23:17.393257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:23:17.393257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:23:17.393257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:23:17.393257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:23:17.393257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:23:17.393257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:23:17.393257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 086aec45-2c47-4b06-9fc9-a19c44a3673a could not be found. May 17 17:23:17.393257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:23:17.394595 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e0b3dd3b-cdbb-4aa4-b67c-2de02383aa0c tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Returning 404 to user: Instance 086aec45-2c47-4b06-9fc9-a19c44a3673a could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:23:17.394595 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e0b3dd3b-cdbb-4aa4-b67c-2de02383aa0c tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "DELETE /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 404 len: 111 microversion: 2.1 time: 0.188695 May 17 17:23:17.394595 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 126/241] 10.222.0.88 () {58 vars in 1238 bytes} [Tue May 17 17:23:17 2022] DELETE /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:23:17.398850 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-53811049-9761-4651-8cca-216ace2effae tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:17.399591 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-53811049-9761-4651-8cca-216ace2effae tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] [instance: 086aec45-2c47-4b06-9fc9-a19c44a3673a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:17.407980 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-53811049-9761-4651-8cca-216ace2effae tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:17.408820 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-53811049-9761-4651-8cca-216ace2effae tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:17.409851 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-53811049-9761-4651-8cca-216ace2effae tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:17.410447 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-53811049-9761-4651-8cca-216ace2effae tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:17.425657 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-53811049-9761-4651-8cca-216ace2effae tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] HTTP exception thrown: Instance 086aec45-2c47-4b06-9fc9-a19c44a3673a could not be found. May 17 17:23:17.427640 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-53811049-9761-4651-8cca-216ace2effae tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Request method failure captured: May 17 17:23:17.427640 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a HTTP/1.1 May 17 17:23:17.427640 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:23:17.427640 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:23:17.427640 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:23:17.427640 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:23:17.427640 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:23:17.427640 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:23:17.427640 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:23:17.427640 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:23:17.427640 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9m3QzaSGB4UOdaHEp9yD5rewgfNZ9wvX4aMQXgKovLYyXBnMOLsXmeM6uA9ovaBMXo9eZQUCk4GosCn0KzVJS0bJcy1eD3_jf1gZ87g5FAacukcS7TYIH_CTsgnvuC-YpRAx6v2N9kt00D6eUBsRPCiLoux7allIX3XxjwaWDE6yZo May 17 17:23:17.427640 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:23:17.427640 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:23:17.427640 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:23:17.427640 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:23:17.427640 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:23:17.427640 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:23:17.427640 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: 7e3052d0bf74405e8b7c964561163e6f May 17 17:23:17.427640 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-DeleteServersTestJSON-105238966 May 17 17:23:17.427640 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:23:17.427640 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:23:17.429006 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7e3052d0bf74405e8b7c964561163e6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/7e3052d0bf74405e8b7c964561163e6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7e3052d0bf74405e8b7c964561163e6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_7e3052d0bf74405e8b7c964561163e6f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:23:17.429006 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-DeleteServersTestJSON-105238966 May 17 17:23:17.429006 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: 7e3052d0bf74405e8b7c964561163e6f May 17 17:23:17.429006 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-DeleteServersTestJSON-105238966 May 17 17:23:17.429006 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-DeleteServersTestJSON-105238966-project May 17 17:23:17.429006 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:23:17.429006 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:23:17.429006 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 98dc9781e62d471eb8705ef299b5693a May 17 17:23:17.429006 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-DeleteServersTestJSON-105238966-project May 17 17:23:17.429006 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:23:17.429006 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Instance 086aec45-2c47-4b06-9fc9-a19c44a3673a could not be found. May 17 17:23:17.429006 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': '086aec45-2c47-4b06-9fc9-a19c44a3673a'} May 17 17:23:17.429836 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:23:17.429836 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:23:17.429836 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:23:17.429836 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:23:17.429836 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:23:17.429836 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:23:17.429836 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:23:17.429836 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:23:17.429836 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:23:17.429836 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:23:17.429836 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 086aec45-2c47-4b06-9fc9-a19c44a3673a could not be found. May 17 17:23:17.429836 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:23:17.429836 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:23:17.429836 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:23:17.429836 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:23:17.429836 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:23:17.429836 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:23:17.429836 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:23:17.429836 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:23:17.429836 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:23:17.430886 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:23:17.430886 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:23:17.430886 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:23:17.430886 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:23:17.430886 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:23:17.430886 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:23:17.430886 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:23:17.430886 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 086aec45-2c47-4b06-9fc9-a19c44a3673a could not be found. May 17 17:23:17.430886 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:23:17.430886 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:23:17.430886 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:23:17.430886 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:23:17.430886 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:23:17.430886 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:23:17.430886 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:23:17.430886 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:23:17.430886 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 086aec45-2c47-4b06-9fc9-a19c44a3673a could not be found. May 17 17:23:17.430886 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:23:17.433290 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-53811049-9761-4651-8cca-216ace2effae tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] Returning 404 to user: Instance 086aec45-2c47-4b06-9fc9-a19c44a3673a could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:23:17.434489 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-53811049-9761-4651-8cca-216ace2effae tempest-DeleteServersTestJSON-105238966 tempest-DeleteServersTestJSON-105238966-project] 10.222.0.88 "GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a" status: 404 len: 111 microversion: 2.1 time: 0.041089 May 17 17:23:17.439658 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 116/242] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:17 2022] GET /compute/v2.1/servers/086aec45-2c47-4b06-9fc9-a19c44a3673a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:23:18.215396 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c2fdeca9-e107-4ec4-b7aa-cef25518991b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:18.216969 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c2fdeca9-e107-4ec4-b7aa-cef25518991b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:18.228127 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c2fdeca9-e107-4ec4-b7aa-cef25518991b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:18.232155 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c2fdeca9-e107-4ec4-b7aa-cef25518991b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:18.233278 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c2fdeca9-e107-4ec4-b7aa-cef25518991b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:18.233951 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c2fdeca9-e107-4ec4-b7aa-cef25518991b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:18.337361 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1b1564c8-e051-4b72-bdf8-123810bbc48e tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:18.337854 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1b1564c8-e051-4b72-bdf8-123810bbc48e tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: c61bb514-0fba-4d7e-b461-b62de8d2c9c3] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:18.352304 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1b1564c8-e051-4b72-bdf8-123810bbc48e tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:18.352858 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1b1564c8-e051-4b72-bdf8-123810bbc48e tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:18.354425 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1b1564c8-e051-4b72-bdf8-123810bbc48e tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:18.358392 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1b1564c8-e051-4b72-bdf8-123810bbc48e tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:18.404970 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1b1564c8-e051-4b72-bdf8-123810bbc48e tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: c61bb514-0fba-4d7e-b461-b62de8d2c9c3] Going to try to terminate instance {{(pid=117611) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:23:18.482722 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c2fdeca9-e107-4ec4-b7aa-cef25518991b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:18.490400 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c2fdeca9-e107-4ec4-b7aa-cef25518991b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.279285 May 17 17:23:18.490965 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 127/243] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:18 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:18.699763 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1b1564c8-e051-4b72-bdf8-123810bbc48e tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3" status: 204 len: 0 microversion: 2.1 time: 0.364719 May 17 17:23:18.699763 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 117/244] 10.222.0.88 () {58 vars in 1238 bytes} [Tue May 17 17:23:18 2022] DELETE /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:23:18.712270 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-61da4ba3-688b-4b2c-8ff9-08dc8c4129ee tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:18.712911 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-61da4ba3-688b-4b2c-8ff9-08dc8c4129ee tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: c61bb514-0fba-4d7e-b461-b62de8d2c9c3] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:18.720977 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-61da4ba3-688b-4b2c-8ff9-08dc8c4129ee tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:18.721426 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-61da4ba3-688b-4b2c-8ff9-08dc8c4129ee tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:18.722387 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-61da4ba3-688b-4b2c-8ff9-08dc8c4129ee tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:18.722888 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-61da4ba3-688b-4b2c-8ff9-08dc8c4129ee tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:18.873908 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ee70ce37-3750-47d7-aafd-4592ef899438 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Action: 'create', calling method: .version_select at 0x7f73d01f90d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-733781755", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsWPfxfrvh/IoE8U23I1A1JkSGAZ3Uz4PUO/CV+EYct1/4Qs+CtZXFNKBtghaOzeuYZLwqI3JWzsPixGVeg9kffRXGhL2XoMxXXWrMYQsHVepcaUoSHRUc0kGsC32REtg=="}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:23:18.888562 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-ee70ce37-3750-47d7-aafd-4592ef899438 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Getting quotas for project 60e4a7b9a0a74c2788facfa3035fc8ab. Resources: {'key_pairs'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:23:18.892666 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-ee70ce37-3750-47d7-aafd-4592ef899438 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Getting quotas for user 0d565f5725984bf6908fd35b557f8736 and project 60e4a7b9a0a74c2788facfa3035fc8ab. Resources: {'key_pairs'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:23:18.936710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-61da4ba3-688b-4b2c-8ff9-08dc8c4129ee tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:18.944921 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-61da4ba3-688b-4b2c-8ff9-08dc8c4129ee tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3" status: 200 len: 1504 microversion: 2.1 time: 0.238456 May 17 17:23:18.945495 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 118/245] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:18 2022] GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3 => generated 1504 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:18.985686 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ee70ce37-3750-47d7-aafd-4592ef899438 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.493135 May 17 17:23:18.986282 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 128/246] 10.222.0.88 () {60 vars in 1158 bytes} [Tue May 17 17:23:18 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:23:19.508183 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-625ffec1-1ac0-4845-abe2-09f0a499ce9d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:19.508836 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-625ffec1-1ac0-4845-abe2-09f0a499ce9d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:19.515210 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-625ffec1-1ac0-4845-abe2-09f0a499ce9d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:19.515877 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-625ffec1-1ac0-4845-abe2-09f0a499ce9d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:19.517336 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-625ffec1-1ac0-4845-abe2-09f0a499ce9d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:19.518017 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-625ffec1-1ac0-4845-abe2-09f0a499ce9d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:19.777189 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-625ffec1-1ac0-4845-abe2-09f0a499ce9d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:19.788731 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-625ffec1-1ac0-4845-abe2-09f0a499ce9d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.284414 May 17 17:23:19.793362 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 119/247] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:19 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:19.962605 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f6cfffc9-d819-492a-ad6e-a9479e3eeca8 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:19.963953 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f6cfffc9-d819-492a-ad6e-a9479e3eeca8 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: c61bb514-0fba-4d7e-b461-b62de8d2c9c3] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:19.970734 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f6cfffc9-d819-492a-ad6e-a9479e3eeca8 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:19.971350 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f6cfffc9-d819-492a-ad6e-a9479e3eeca8 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:19.972161 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f6cfffc9-d819-492a-ad6e-a9479e3eeca8 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:19.972734 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f6cfffc9-d819-492a-ad6e-a9479e3eeca8 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:20.124736 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f6cfffc9-d819-492a-ad6e-a9479e3eeca8 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:20.132387 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f6cfffc9-d819-492a-ad6e-a9479e3eeca8 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3" status: 200 len: 1504 microversion: 2.1 time: 0.173778 May 17 17:23:20.132945 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 129/248] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:19 2022] GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3 => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:20.808945 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ca0f8012-c3c9-4897-b34e-13caf8fd6f6a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:20.814767 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ca0f8012-c3c9-4897-b34e-13caf8fd6f6a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:20.831696 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ca0f8012-c3c9-4897-b34e-13caf8fd6f6a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:20.832379 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ca0f8012-c3c9-4897-b34e-13caf8fd6f6a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:20.833160 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ca0f8012-c3c9-4897-b34e-13caf8fd6f6a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:20.833620 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ca0f8012-c3c9-4897-b34e-13caf8fd6f6a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:21.067104 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ca0f8012-c3c9-4897-b34e-13caf8fd6f6a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:21.075635 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ca0f8012-c3c9-4897-b34e-13caf8fd6f6a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.270625 May 17 17:23:21.091068 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 120/249] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:20 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:21.092027 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-d8630f27-99fd-4187-be9d-5d8f01e0e5bc req-1058993e-8b8c-43ed-b777-2b02365d4bfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c61bb514-0fba-4d7e-b461-b62de8d2c9c3", "name": "network-vif-deleted", "tag": "4fd9330b-e9ba-45cc-8c1d-1c66429a372a"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:23:21.100575 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-d8630f27-99fd-4187-be9d-5d8f01e0e5bc req-1058993e-8b8c-43ed-b777-2b02365d4bfc service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:21.101044 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-d8630f27-99fd-4187-be9d-5d8f01e0e5bc req-1058993e-8b8c-43ed-b777-2b02365d4bfc service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:21.120025 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-d8630f27-99fd-4187-be9d-5d8f01e0e5bc req-1058993e-8b8c-43ed-b777-2b02365d4bfc service nova] Creating event network-vif-deleted:4fd9330b-e9ba-45cc-8c1d-1c66429a372a for instance c61bb514-0fba-4d7e-b461-b62de8d2c9c3 on hv-cinder-84214 May 17 17:23:21.120025 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-d8630f27-99fd-4187-be9d-5d8f01e0e5bc req-1058993e-8b8c-43ed-b777-2b02365d4bfc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031175 May 17 17:23:21.120368 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 130/250] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:23:21.149611 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4a98e08c-38f3-4a0f-bd5c-b0d5f828c02a tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:21.150218 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4a98e08c-38f3-4a0f-bd5c-b0d5f828c02a tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: c61bb514-0fba-4d7e-b461-b62de8d2c9c3] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:21.156730 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4a98e08c-38f3-4a0f-bd5c-b0d5f828c02a tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:21.157710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4a98e08c-38f3-4a0f-bd5c-b0d5f828c02a tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:21.158474 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4a98e08c-38f3-4a0f-bd5c-b0d5f828c02a tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:21.158905 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4a98e08c-38f3-4a0f-bd5c-b0d5f828c02a tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:21.465129 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4a98e08c-38f3-4a0f-bd5c-b0d5f828c02a tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:21.476591 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4a98e08c-38f3-4a0f-bd5c-b0d5f828c02a tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3" status: 200 len: 1462 microversion: 2.1 time: 0.330805 May 17 17:23:21.477184 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 121/251] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:21 2022] GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3 => generated 1462 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:22.101936 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b1b099cb-6fc6-4bd2-8cda-c578ab40653c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:22.101936 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b1b099cb-6fc6-4bd2-8cda-c578ab40653c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:22.101936 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b1b099cb-6fc6-4bd2-8cda-c578ab40653c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:22.101936 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b1b099cb-6fc6-4bd2-8cda-c578ab40653c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:22.103098 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b1b099cb-6fc6-4bd2-8cda-c578ab40653c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:22.103098 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b1b099cb-6fc6-4bd2-8cda-c578ab40653c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:22.253251 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b1b099cb-6fc6-4bd2-8cda-c578ab40653c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:22.253251 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b1b099cb-6fc6-4bd2-8cda-c578ab40653c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.160152 May 17 17:23:22.253251 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 131/252] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:22 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:22.493729 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-99fe963b-ea31-4a4d-a98d-0ed60bed99f4 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:22.494419 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-99fe963b-ea31-4a4d-a98d-0ed60bed99f4 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: c61bb514-0fba-4d7e-b461-b62de8d2c9c3] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:22.500965 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-99fe963b-ea31-4a4d-a98d-0ed60bed99f4 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:22.501468 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-99fe963b-ea31-4a4d-a98d-0ed60bed99f4 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:22.502219 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-99fe963b-ea31-4a4d-a98d-0ed60bed99f4 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:22.502647 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-99fe963b-ea31-4a4d-a98d-0ed60bed99f4 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:22.534257 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-99fe963b-ea31-4a4d-a98d-0ed60bed99f4 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:22.534704 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-99fe963b-ea31-4a4d-a98d-0ed60bed99f4 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:22.535162 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.objects.instance [None req-99fe963b-ea31-4a4d-a98d-0ed60bed99f4 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lazy-loading 'fault' on Instance uuid c61bb514-0fba-4d7e-b461-b62de8d2c9c3 {{(pid=117611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:23:22.580068 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-99fe963b-ea31-4a4d-a98d-0ed60bed99f4 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:22.589173 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-99fe963b-ea31-4a4d-a98d-0ed60bed99f4 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3" status: 200 len: 1304 microversion: 2.1 time: 0.099337 May 17 17:23:22.595399 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 122/253] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:22 2022] GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:23.267686 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-9b3ccebf-1ee0-429f-a429-a72cc250b3df tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:23.268381 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-9b3ccebf-1ee0-429f-a429-a72cc250b3df tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:23.274497 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9b3ccebf-1ee0-429f-a429-a72cc250b3df tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:23.274941 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9b3ccebf-1ee0-429f-a429-a72cc250b3df tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:23.276131 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9b3ccebf-1ee0-429f-a429-a72cc250b3df tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:23.276504 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9b3ccebf-1ee0-429f-a429-a72cc250b3df tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:23.417873 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-9b3ccebf-1ee0-429f-a429-a72cc250b3df tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:23.426222 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-9b3ccebf-1ee0-429f-a429-a72cc250b3df tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.163874 May 17 17:23:23.432676 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 132/254] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:23 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:23.607298 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-62325732-d8ea-4ed0-8cf3-fbeeeae02df5 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:23.608146 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-62325732-d8ea-4ed0-8cf3-fbeeeae02df5 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: c61bb514-0fba-4d7e-b461-b62de8d2c9c3] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:23.615228 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-62325732-d8ea-4ed0-8cf3-fbeeeae02df5 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:23.618786 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-62325732-d8ea-4ed0-8cf3-fbeeeae02df5 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:23.618786 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-62325732-d8ea-4ed0-8cf3-fbeeeae02df5 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:23.618786 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-62325732-d8ea-4ed0-8cf3-fbeeeae02df5 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:23.631761 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-62325732-d8ea-4ed0-8cf3-fbeeeae02df5 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] HTTP exception thrown: Instance c61bb514-0fba-4d7e-b461-b62de8d2c9c3 could not be found. May 17 17:23:23.633453 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-62325732-d8ea-4ed0-8cf3-fbeeeae02df5 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Request method failure captured: May 17 17:23:23.633453 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3 HTTP/1.1 May 17 17:23:23.633453 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:23:23.633453 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:23:23.633453 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:23:23.633453 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:23:23.633453 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:23:23.633453 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:23:23.633453 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:23:23.633453 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:23:23.633453 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9nsOSWdRIPDuDWvfKGF6m9UoWtYzEBziZ5bWddoN9ygg8OKf_NjI_TP_wq_KpN1M0u_ObJtPrgbAwjaJEwRw_Zla4GN1sj2XwZNxTZnhdAnLCFF27AedkRl7dhzXQVk1dpgj6EBn_tsEoGfjFr0rlYbsgwXBUdb1W52NFoLFCf1uW4 May 17 17:23:23.633453 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:23:23.633453 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:23:23.633453 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:23:23.633453 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:23:23.633453 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:23:23.633453 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:23:23.633453 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: 0f914985c201429e845986b973e37490 May 17 17:23:23.633453 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-VolumesActionsTest-1287484978 May 17 17:23:23.633453 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:23:23.633453 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:23:23.634926 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0f914985c201429e845986b973e37490"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0f914985c201429e845986b973e37490"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0f914985c201429e845986b973e37490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0f914985c201429e845986b973e37490", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:23:23.634926 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-VolumesActionsTest-1287484978 May 17 17:23:23.634926 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: 0f914985c201429e845986b973e37490 May 17 17:23:23.634926 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-VolumesActionsTest-1287484978 May 17 17:23:23.634926 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-VolumesActionsTest-1287484978-project May 17 17:23:23.634926 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:23:23.634926 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:23:23.634926 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 3dedebb1073a43109e45a3d73a8bc62f May 17 17:23:23.634926 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-VolumesActionsTest-1287484978-project May 17 17:23:23.634926 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:23:23.634926 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Instance c61bb514-0fba-4d7e-b461-b62de8d2c9c3 could not be found. May 17 17:23:23.634926 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': 'c61bb514-0fba-4d7e-b461-b62de8d2c9c3'} May 17 17:23:23.635901 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:23:23.635901 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:23:23.635901 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:23:23.635901 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:23:23.635901 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:23:23.635901 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:23:23.635901 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:23:23.635901 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:23:23.635901 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:23:23.635901 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:23:23.635901 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c61bb514-0fba-4d7e-b461-b62de8d2c9c3 could not be found. May 17 17:23:23.635901 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:23:23.635901 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:23:23.635901 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:23:23.635901 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:23:23.635901 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:23:23.635901 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:23:23.635901 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:23:23.635901 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:23:23.635901 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:23:23.637155 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:23:23.637155 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:23:23.637155 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:23:23.637155 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:23:23.637155 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:23:23.637155 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:23:23.637155 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:23:23.637155 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c61bb514-0fba-4d7e-b461-b62de8d2c9c3 could not be found. May 17 17:23:23.637155 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:23:23.637155 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:23:23.637155 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:23:23.637155 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:23:23.637155 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:23:23.637155 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:23:23.637155 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:23:23.637155 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:23:23.637155 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c61bb514-0fba-4d7e-b461-b62de8d2c9c3 could not be found. May 17 17:23:23.637155 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:23:23.638354 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-62325732-d8ea-4ed0-8cf3-fbeeeae02df5 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Returning 404 to user: Instance c61bb514-0fba-4d7e-b461-b62de8d2c9c3 could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:23:23.638354 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-62325732-d8ea-4ed0-8cf3-fbeeeae02df5 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3" status: 404 len: 111 microversion: 2.1 time: 0.031833 May 17 17:23:23.638354 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 123/255] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:23 2022] GET /compute/v2.1/servers/c61bb514-0fba-4d7e-b461-b62de8d2c9c3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:23:23.772458 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-fecc3193-9fa2-40a7-9450-0e01a234fd5b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1639870086", "imageRef": "800c492c-ff69-4735-b2c9-a2dcaa20aa8d", "flavorRef": "452", "networks": [{"uuid": "a5c101a4-1fda-42e3-b2a2-b374c0d3a657"}]}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:23:23.845826 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.network.neutron [None req-fecc3193-9fa2-40a7-9450-0e01a234fd5b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] validate_networks() for [('a5c101a4-1fda-42e3-b2a2-b374c0d3a657', None, None, None, None, None)] {{(pid=117612) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:23:24.219895 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-fecc3193-9fa2-40a7-9450-0e01a234fd5b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Flavor limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:23:24.220316 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-fecc3193-9fa2-40a7-9450-0e01a234fd5b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Image limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:23:24.221090 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-fecc3193-9fa2-40a7-9450-0e01a234fd5b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Flavor pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:23:24.221534 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-fecc3193-9fa2-40a7-9450-0e01a234fd5b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Image pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:23:24.221999 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-fecc3193-9fa2-40a7-9450-0e01a234fd5b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:23:24.231386 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fecc3193-9fa2-40a7-9450-0e01a234fd5b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:24.235038 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fecc3193-9fa2-40a7-9450-0e01a234fd5b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:24.236145 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fecc3193-9fa2-40a7-9450-0e01a234fd5b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:24.236633 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fecc3193-9fa2-40a7-9450-0e01a234fd5b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:24.256625 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-fecc3193-9fa2-40a7-9450-0e01a234fd5b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Getting quotas for project 0f914985c201429e845986b973e37490. Resources: {'cores', 'ram', 'instances'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:23:24.261274 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-fecc3193-9fa2-40a7-9450-0e01a234fd5b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Getting quotas for user 3dedebb1073a43109e45a3d73a8bc62f and project 0f914985c201429e845986b973e37490. Resources: {'cores', 'ram', 'instances'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:23:24.273703 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-fecc3193-9fa2-40a7-9450-0e01a234fd5b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Going to run 1 instances... {{(pid=117612) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:23:24.276406 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-fecc3193-9fa2-40a7-9450-0e01a234fd5b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: 1b81b065-e5af-42ff-ab02-a137db1a1f08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='800c492c-ff69-4735-b2c9-a2dcaa20aa8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:23:24.449087 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-062c9236-53f1-48da-b6a3-1bee2e2823e0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:24.449677 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-062c9236-53f1-48da-b6a3-1bee2e2823e0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:24.456559 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-062c9236-53f1-48da-b6a3-1bee2e2823e0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:24.457051 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-062c9236-53f1-48da-b6a3-1bee2e2823e0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:24.457842 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-062c9236-53f1-48da-b6a3-1bee2e2823e0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:24.458324 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-062c9236-53f1-48da-b6a3-1bee2e2823e0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:24.593966 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-062c9236-53f1-48da-b6a3-1bee2e2823e0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:24.601572 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-062c9236-53f1-48da-b6a3-1bee2e2823e0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.156935 May 17 17:23:24.607459 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 124/256] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:24 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:23:24.649578 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-fecc3193-9fa2-40a7-9450-0e01a234fd5b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.880920 May 17 17:23:24.650230 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 133/257] 10.222.0.88 () {60 vars in 1146 bytes} [Tue May 17 17:23:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:23:24.660500 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-2d798851-96c2-4ea3-bcf5-1e6e08e0ddfb tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:24.661133 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-2d798851-96c2-4ea3-bcf5-1e6e08e0ddfb tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: 1b81b065-e5af-42ff-ab02-a137db1a1f08] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:24.720213 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2d798851-96c2-4ea3-bcf5-1e6e08e0ddfb tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:24.728130 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-2d798851-96c2-4ea3-bcf5-1e6e08e0ddfb tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08" status: 200 len: 1214 microversion: 2.1 time: 0.071343 May 17 17:23:24.729045 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 125/258] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:24 2022] GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:25.622966 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-cc6902db-a950-4df5-9efb-45bb3fff6733 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:25.625511 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-cc6902db-a950-4df5-9efb-45bb3fff6733 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:25.631972 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cc6902db-a950-4df5-9efb-45bb3fff6733 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:25.632534 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cc6902db-a950-4df5-9efb-45bb3fff6733 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:25.633339 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cc6902db-a950-4df5-9efb-45bb3fff6733 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:25.633755 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cc6902db-a950-4df5-9efb-45bb3fff6733 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:25.746174 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-bd73fdee-9b6f-403f-a2a4-fb7190db16fb tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:25.747754 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-bd73fdee-9b6f-403f-a2a4-fb7190db16fb tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: 1b81b065-e5af-42ff-ab02-a137db1a1f08] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:25.754809 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bd73fdee-9b6f-403f-a2a4-fb7190db16fb tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:25.755256 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bd73fdee-9b6f-403f-a2a4-fb7190db16fb tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:25.756057 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bd73fdee-9b6f-403f-a2a4-fb7190db16fb tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:25.756721 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bd73fdee-9b6f-403f-a2a4-fb7190db16fb tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:25.773112 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-cc6902db-a950-4df5-9efb-45bb3fff6733 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:25.782369 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-cc6902db-a950-4df5-9efb-45bb3fff6733 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.163036 May 17 17:23:25.783041 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 134/259] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:25 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:25.827786 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-bd73fdee-9b6f-403f-a2a4-fb7190db16fb tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:25.836405 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-bd73fdee-9b6f-403f-a2a4-fb7190db16fb tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08" status: 200 len: 1218 microversion: 2.1 time: 0.094102 May 17 17:23:25.837109 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 126/260] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:25 2022] GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:23:26.799838 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8b95c5d9-41c4-4f78-8d1d-951eb6c50230 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:26.800470 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8b95c5d9-41c4-4f78-8d1d-951eb6c50230 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:26.806404 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8b95c5d9-41c4-4f78-8d1d-951eb6c50230 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:26.806855 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8b95c5d9-41c4-4f78-8d1d-951eb6c50230 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:26.807656 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8b95c5d9-41c4-4f78-8d1d-951eb6c50230 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:26.808100 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8b95c5d9-41c4-4f78-8d1d-951eb6c50230 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:26.853464 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-dace3793-aa2c-4b4a-a6ab-7c2f0bbe4670 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:26.854082 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-dace3793-aa2c-4b4a-a6ab-7c2f0bbe4670 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: 1b81b065-e5af-42ff-ab02-a137db1a1f08] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:26.860362 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-dace3793-aa2c-4b4a-a6ab-7c2f0bbe4670 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:26.860813 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-dace3793-aa2c-4b4a-a6ab-7c2f0bbe4670 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:26.861580 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-dace3793-aa2c-4b4a-a6ab-7c2f0bbe4670 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:26.862011 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-dace3793-aa2c-4b4a-a6ab-7c2f0bbe4670 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:26.936979 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-dace3793-aa2c-4b4a-a6ab-7c2f0bbe4670 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:26.950533 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-dace3793-aa2c-4b4a-a6ab-7c2f0bbe4670 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08" status: 200 len: 1266 microversion: 2.1 time: 0.100790 May 17 17:23:26.951112 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 127/261] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:26 2022] GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08 => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:23:26.992376 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8b95c5d9-41c4-4f78-8d1d-951eb6c50230 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:27.000823 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8b95c5d9-41c4-4f78-8d1d-951eb6c50230 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.204063 May 17 17:23:27.001635 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 135/262] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:26 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:27.971906 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f1e79d53-9777-4880-84ff-fb568867dad1 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:27.972626 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f1e79d53-9777-4880-84ff-fb568867dad1 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: 1b81b065-e5af-42ff-ab02-a137db1a1f08] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:27.982071 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f1e79d53-9777-4880-84ff-fb568867dad1 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:27.982536 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f1e79d53-9777-4880-84ff-fb568867dad1 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:27.983295 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f1e79d53-9777-4880-84ff-fb568867dad1 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:27.983869 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f1e79d53-9777-4880-84ff-fb568867dad1 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:28.018258 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1c3e4b24-b51c-471a-943e-3457921214d4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:28.019025 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1c3e4b24-b51c-471a-943e-3457921214d4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:28.028402 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1c3e4b24-b51c-471a-943e-3457921214d4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:28.030164 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1c3e4b24-b51c-471a-943e-3457921214d4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:28.030967 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1c3e4b24-b51c-471a-943e-3457921214d4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:28.034176 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1c3e4b24-b51c-471a-943e-3457921214d4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:28.221390 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f1e79d53-9777-4880-84ff-fb568867dad1 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:28.228763 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f1e79d53-9777-4880-84ff-fb568867dad1 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08" status: 200 len: 1314 microversion: 2.1 time: 0.261190 May 17 17:23:28.229886 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 128/263] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:27 2022] GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:28.258468 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1c3e4b24-b51c-471a-943e-3457921214d4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:28.266195 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1c3e4b24-b51c-471a-943e-3457921214d4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.251958 May 17 17:23:28.266747 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 136/264] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:28 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:28.868085 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-f4e99440-1a3a-4048-a84e-dac57358dd68 req-47898f0d-254b-41e8-b5eb-c842803644e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b81b065-e5af-42ff-ab02-a137db1a1f08", "tag": "61eeae45-2af1-4e47-9cfe-927a2bda1c4b"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:23:28.880695 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-f4e99440-1a3a-4048-a84e-dac57358dd68 req-47898f0d-254b-41e8-b5eb-c842803644e7 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:28.882543 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-f4e99440-1a3a-4048-a84e-dac57358dd68 req-47898f0d-254b-41e8-b5eb-c842803644e7 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:28.899644 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-f4e99440-1a3a-4048-a84e-dac57358dd68 req-47898f0d-254b-41e8-b5eb-c842803644e7 service nova] Creating event network-changed:61eeae45-2af1-4e47-9cfe-927a2bda1c4b for instance 1b81b065-e5af-42ff-ab02-a137db1a1f08 on hv-cinder-84214 May 17 17:23:28.900774 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-f4e99440-1a3a-4048-a84e-dac57358dd68 req-47898f0d-254b-41e8-b5eb-c842803644e7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041081 May 17 17:23:28.901376 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 129/265] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:23:29.246600 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-fae42627-9c8e-4029-8bd4-9eaba8b4413b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:29.247236 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-fae42627-9c8e-4029-8bd4-9eaba8b4413b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: 1b81b065-e5af-42ff-ab02-a137db1a1f08] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:29.253766 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fae42627-9c8e-4029-8bd4-9eaba8b4413b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:29.254214 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fae42627-9c8e-4029-8bd4-9eaba8b4413b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:29.254994 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fae42627-9c8e-4029-8bd4-9eaba8b4413b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:29.255432 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fae42627-9c8e-4029-8bd4-9eaba8b4413b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:29.283834 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ae4e8977-7e55-4f3d-9a18-ad15a5bc3e75 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:29.284532 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ae4e8977-7e55-4f3d-9a18-ad15a5bc3e75 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:29.291074 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ae4e8977-7e55-4f3d-9a18-ad15a5bc3e75 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:29.292919 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ae4e8977-7e55-4f3d-9a18-ad15a5bc3e75 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:29.292919 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ae4e8977-7e55-4f3d-9a18-ad15a5bc3e75 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:29.292919 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ae4e8977-7e55-4f3d-9a18-ad15a5bc3e75 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:29.493671 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-fae42627-9c8e-4029-8bd4-9eaba8b4413b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:29.503387 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-fae42627-9c8e-4029-8bd4-9eaba8b4413b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08" status: 200 len: 1314 microversion: 2.1 time: 0.260696 May 17 17:23:29.504613 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 137/266] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:29 2022] GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:29.544902 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ae4e8977-7e55-4f3d-9a18-ad15a5bc3e75 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:29.552413 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ae4e8977-7e55-4f3d-9a18-ad15a5bc3e75 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.273170 May 17 17:23:29.552988 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 130/267] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:29 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:23:30.521186 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-9762cf76-2411-47ba-bd1d-11fd4e929fe2 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:30.522539 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-9762cf76-2411-47ba-bd1d-11fd4e929fe2 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: 1b81b065-e5af-42ff-ab02-a137db1a1f08] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:30.527608 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9762cf76-2411-47ba-bd1d-11fd4e929fe2 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:30.528021 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9762cf76-2411-47ba-bd1d-11fd4e929fe2 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:30.528776 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9762cf76-2411-47ba-bd1d-11fd4e929fe2 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:30.529466 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9762cf76-2411-47ba-bd1d-11fd4e929fe2 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:30.569731 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3df94caf-353c-402b-9e9d-ce4c296ecece tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:30.570821 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3df94caf-353c-402b-9e9d-ce4c296ecece tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:30.579223 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3df94caf-353c-402b-9e9d-ce4c296ecece tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:30.579863 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3df94caf-353c-402b-9e9d-ce4c296ecece tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:30.581019 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3df94caf-353c-402b-9e9d-ce4c296ecece tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:30.581774 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3df94caf-353c-402b-9e9d-ce4c296ecece tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:30.746567 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-9762cf76-2411-47ba-bd1d-11fd4e929fe2 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:30.754262 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-9762cf76-2411-47ba-bd1d-11fd4e929fe2 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08" status: 200 len: 1314 microversion: 2.1 time: 0.236854 May 17 17:23:30.755377 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 138/268] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:30 2022] GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:30.787620 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3df94caf-353c-402b-9e9d-ce4c296ecece tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:30.795341 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3df94caf-353c-402b-9e9d-ce4c296ecece tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.229612 May 17 17:23:30.796146 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 131/269] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:30 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:23:31.771394 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3ab171f5-da0f-4fd9-b96e-db8439e2b3d7 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:31.772042 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3ab171f5-da0f-4fd9-b96e-db8439e2b3d7 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: 1b81b065-e5af-42ff-ab02-a137db1a1f08] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:31.778322 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3ab171f5-da0f-4fd9-b96e-db8439e2b3d7 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:31.778780 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3ab171f5-da0f-4fd9-b96e-db8439e2b3d7 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:31.779866 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3ab171f5-da0f-4fd9-b96e-db8439e2b3d7 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:31.780308 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3ab171f5-da0f-4fd9-b96e-db8439e2b3d7 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:31.814273 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4812b780-ae7d-4e56-9684-b04025ae7a00 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:31.815072 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4812b780-ae7d-4e56-9684-b04025ae7a00 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:31.821766 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4812b780-ae7d-4e56-9684-b04025ae7a00 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:31.822215 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4812b780-ae7d-4e56-9684-b04025ae7a00 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:31.822979 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4812b780-ae7d-4e56-9684-b04025ae7a00 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:31.823408 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4812b780-ae7d-4e56-9684-b04025ae7a00 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:32.011068 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-3ab171f5-da0f-4fd9-b96e-db8439e2b3d7 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:32.020262 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3ab171f5-da0f-4fd9-b96e-db8439e2b3d7 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08" status: 200 len: 1314 microversion: 2.1 time: 0.252851 May 17 17:23:32.020931 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 139/270] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:31 2022] GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:32.024117 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4812b780-ae7d-4e56-9684-b04025ae7a00 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:32.031718 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4812b780-ae7d-4e56-9684-b04025ae7a00 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.223116 May 17 17:23:32.032280 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 132/271] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:31 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:23:33.037939 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b24879e7-98a4-409c-b848-fe632d51c03a tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:33.039110 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b24879e7-98a4-409c-b848-fe632d51c03a tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: 1b81b065-e5af-42ff-ab02-a137db1a1f08] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:33.046022 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b24879e7-98a4-409c-b848-fe632d51c03a tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:33.046464 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b24879e7-98a4-409c-b848-fe632d51c03a tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:33.047947 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b24879e7-98a4-409c-b848-fe632d51c03a tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:33.048375 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b24879e7-98a4-409c-b848-fe632d51c03a tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:33.049216 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ef925fa2-e0e5-4ce2-862d-74dfc511db0e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:33.049895 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ef925fa2-e0e5-4ce2-862d-74dfc511db0e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:33.056509 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ef925fa2-e0e5-4ce2-862d-74dfc511db0e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:33.056968 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ef925fa2-e0e5-4ce2-862d-74dfc511db0e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:33.057837 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ef925fa2-e0e5-4ce2-862d-74dfc511db0e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:33.058281 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ef925fa2-e0e5-4ce2-862d-74dfc511db0e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:33.242372 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b24879e7-98a4-409c-b848-fe632d51c03a tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:33.255891 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b24879e7-98a4-409c-b848-fe632d51c03a tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08" status: 200 len: 1314 microversion: 2.1 time: 0.222805 May 17 17:23:33.256817 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 140/272] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:33 2022] GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:33.273348 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ef925fa2-e0e5-4ce2-862d-74dfc511db0e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:33.282028 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ef925fa2-e0e5-4ce2-862d-74dfc511db0e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.236941 May 17 17:23:33.283570 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 133/273] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:33 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:23:34.273228 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f1c392c9-fc06-405e-8fd6-528f0cb22935 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:34.273839 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f1c392c9-fc06-405e-8fd6-528f0cb22935 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: 1b81b065-e5af-42ff-ab02-a137db1a1f08] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:34.279971 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f1c392c9-fc06-405e-8fd6-528f0cb22935 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:34.280417 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f1c392c9-fc06-405e-8fd6-528f0cb22935 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:34.281666 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f1c392c9-fc06-405e-8fd6-528f0cb22935 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:34.282242 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f1c392c9-fc06-405e-8fd6-528f0cb22935 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:34.298471 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-0b584697-2273-44b9-a7f9-d8b096236ea8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:34.299128 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-0b584697-2273-44b9-a7f9-d8b096236ea8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:34.305320 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0b584697-2273-44b9-a7f9-d8b096236ea8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:34.306265 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0b584697-2273-44b9-a7f9-d8b096236ea8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:34.307115 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0b584697-2273-44b9-a7f9-d8b096236ea8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:34.307576 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0b584697-2273-44b9-a7f9-d8b096236ea8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:34.480917 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f1c392c9-fc06-405e-8fd6-528f0cb22935 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:34.488686 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f1c392c9-fc06-405e-8fd6-528f0cb22935 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08" status: 200 len: 1314 microversion: 2.1 time: 0.219289 May 17 17:23:34.489978 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 141/274] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:34 2022] GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:23:34.497409 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-0b584697-2273-44b9-a7f9-d8b096236ea8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:34.505270 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-0b584697-2273-44b9-a7f9-d8b096236ea8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.210989 May 17 17:23:34.514226 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 134/275] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:34 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:23:35.506196 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e78ad80c-4657-4b2d-89a8-14d692b97f55 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:35.506711 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e78ad80c-4657-4b2d-89a8-14d692b97f55 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: 1b81b065-e5af-42ff-ab02-a137db1a1f08] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:35.512848 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e78ad80c-4657-4b2d-89a8-14d692b97f55 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:35.513297 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e78ad80c-4657-4b2d-89a8-14d692b97f55 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:35.514061 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e78ad80c-4657-4b2d-89a8-14d692b97f55 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:35.514525 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e78ad80c-4657-4b2d-89a8-14d692b97f55 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:35.523671 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-27ee492b-7ba5-403d-a531-5674b5c416df tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:35.524419 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-27ee492b-7ba5-403d-a531-5674b5c416df tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:35.530667 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-27ee492b-7ba5-403d-a531-5674b5c416df tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:35.531670 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-27ee492b-7ba5-403d-a531-5674b5c416df tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:35.532665 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-27ee492b-7ba5-403d-a531-5674b5c416df tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:35.533097 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-27ee492b-7ba5-403d-a531-5674b5c416df tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:35.717178 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e78ad80c-4657-4b2d-89a8-14d692b97f55 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:35.720555 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-27ee492b-7ba5-403d-a531-5674b5c416df tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:35.725052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e78ad80c-4657-4b2d-89a8-14d692b97f55 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08" status: 200 len: 1314 microversion: 2.1 time: 0.222860 May 17 17:23:35.725847 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 142/276] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:35 2022] GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:35.727850 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-27ee492b-7ba5-403d-a531-5674b5c416df tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.209436 May 17 17:23:35.728407 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 135/277] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:35 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:23:36.741885 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4fe50add-b4ea-485b-b210-221b101189f2 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:36.742401 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4fe50add-b4ea-485b-b210-221b101189f2 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: 1b81b065-e5af-42ff-ab02-a137db1a1f08] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:36.744633 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-2b93e668-f7c7-4eb3-89dd-d036caabca87 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:36.745246 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-2b93e668-f7c7-4eb3-89dd-d036caabca87 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:36.748814 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4fe50add-b4ea-485b-b210-221b101189f2 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:36.749291 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4fe50add-b4ea-485b-b210-221b101189f2 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:36.750659 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4fe50add-b4ea-485b-b210-221b101189f2 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:36.751109 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4fe50add-b4ea-485b-b210-221b101189f2 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:36.752165 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2b93e668-f7c7-4eb3-89dd-d036caabca87 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:36.752613 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2b93e668-f7c7-4eb3-89dd-d036caabca87 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:36.753372 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2b93e668-f7c7-4eb3-89dd-d036caabca87 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:36.753861 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2b93e668-f7c7-4eb3-89dd-d036caabca87 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:36.955292 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4fe50add-b4ea-485b-b210-221b101189f2 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:36.963006 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2b93e668-f7c7-4eb3-89dd-d036caabca87 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:36.964265 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4fe50add-b4ea-485b-b210-221b101189f2 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08" status: 200 len: 1314 microversion: 2.1 time: 0.226156 May 17 17:23:36.964835 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 143/278] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:36 2022] GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:36.970767 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-2b93e668-f7c7-4eb3-89dd-d036caabca87 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.229861 May 17 17:23:36.971326 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 136/279] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:36 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:23:37.982440 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-66e0e952-9fd9-4c9b-8460-7ee0ed653438 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:37.982440 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-66e0e952-9fd9-4c9b-8460-7ee0ed653438 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: 1b81b065-e5af-42ff-ab02-a137db1a1f08] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:37.987739 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-66e0e952-9fd9-4c9b-8460-7ee0ed653438 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:37.987896 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-bb622fab-f05b-42ef-afd2-6419a44840d0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:37.988333 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-66e0e952-9fd9-4c9b-8460-7ee0ed653438 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:37.988943 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-66e0e952-9fd9-4c9b-8460-7ee0ed653438 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:37.989076 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-bb622fab-f05b-42ef-afd2-6419a44840d0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:37.989379 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-66e0e952-9fd9-4c9b-8460-7ee0ed653438 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:37.995710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bb622fab-f05b-42ef-afd2-6419a44840d0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:37.996160 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bb622fab-f05b-42ef-afd2-6419a44840d0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:37.996936 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bb622fab-f05b-42ef-afd2-6419a44840d0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:37.997369 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bb622fab-f05b-42ef-afd2-6419a44840d0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:38.174527 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-bb622fab-f05b-42ef-afd2-6419a44840d0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:38.177506 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-66e0e952-9fd9-4c9b-8460-7ee0ed653438 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:38.182124 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-bb622fab-f05b-42ef-afd2-6419a44840d0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.198219 May 17 17:23:38.182633 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 137/280] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:37 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:38.184886 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-66e0e952-9fd9-4c9b-8460-7ee0ed653438 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08" status: 200 len: 1314 microversion: 2.1 time: 0.207533 May 17 17:23:38.185473 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 144/281] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:37 2022] GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:39.075373 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-cad1d7a3-ee4a-453d-b780-88173b9c4100 req-aad276d9-7149-4567-b8fa-3a956a124101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b81b065-e5af-42ff-ab02-a137db1a1f08", "name": "network-vif-plugged", "status": "completed", "tag": "61eeae45-2af1-4e47-9cfe-927a2bda1c4b"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:23:39.084398 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-cad1d7a3-ee4a-453d-b780-88173b9c4100 req-aad276d9-7149-4567-b8fa-3a956a124101 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:39.084907 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-cad1d7a3-ee4a-453d-b780-88173b9c4100 req-aad276d9-7149-4567-b8fa-3a956a124101 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:39.096221 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-cad1d7a3-ee4a-453d-b780-88173b9c4100 req-aad276d9-7149-4567-b8fa-3a956a124101 service nova] Creating event network-vif-plugged:61eeae45-2af1-4e47-9cfe-927a2bda1c4b for instance 1b81b065-e5af-42ff-ab02-a137db1a1f08 on hv-cinder-84214 May 17 17:23:39.101274 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-cad1d7a3-ee4a-453d-b780-88173b9c4100 req-aad276d9-7149-4567-b8fa-3a956a124101 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031237 May 17 17:23:39.101897 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 138/282] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:23:39.202389 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f68a4742-cf38-4751-8a95-d5d1bdd4da93 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:39.202999 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-245dd7e8-6738-4919-80b8-1f0901d7b218 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:39.203884 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-245dd7e8-6738-4919-80b8-1f0901d7b218 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: 1b81b065-e5af-42ff-ab02-a137db1a1f08] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:39.204896 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f68a4742-cf38-4751-8a95-d5d1bdd4da93 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:39.211393 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f68a4742-cf38-4751-8a95-d5d1bdd4da93 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:39.211875 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f68a4742-cf38-4751-8a95-d5d1bdd4da93 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:39.212647 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f68a4742-cf38-4751-8a95-d5d1bdd4da93 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:39.213079 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f68a4742-cf38-4751-8a95-d5d1bdd4da93 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:39.214732 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-245dd7e8-6738-4919-80b8-1f0901d7b218 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:39.215207 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-245dd7e8-6738-4919-80b8-1f0901d7b218 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:39.216214 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-245dd7e8-6738-4919-80b8-1f0901d7b218 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:39.216658 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-245dd7e8-6738-4919-80b8-1f0901d7b218 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:39.426291 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f68a4742-cf38-4751-8a95-d5d1bdd4da93 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:39.430211 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-245dd7e8-6738-4919-80b8-1f0901d7b218 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:39.434187 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f68a4742-cf38-4751-8a95-d5d1bdd4da93 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.239070 May 17 17:23:39.434938 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 145/283] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:39 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:39.437489 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-245dd7e8-6738-4919-80b8-1f0901d7b218 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08" status: 200 len: 1314 microversion: 2.1 time: 0.239618 May 17 17:23:39.438206 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 139/284] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:39 2022] GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:40.451573 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-fd184175-758b-47d2-93ff-ac40807749d3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:40.451935 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-fd184175-758b-47d2-93ff-ac40807749d3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:40.454545 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a1f18831-1972-4c82-bd05-acf53009f068 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:40.455127 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a1f18831-1972-4c82-bd05-acf53009f068 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: 1b81b065-e5af-42ff-ab02-a137db1a1f08] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:40.459176 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fd184175-758b-47d2-93ff-ac40807749d3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:40.459659 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fd184175-758b-47d2-93ff-ac40807749d3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:40.460559 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fd184175-758b-47d2-93ff-ac40807749d3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:40.461143 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fd184175-758b-47d2-93ff-ac40807749d3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:40.461621 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a1f18831-1972-4c82-bd05-acf53009f068 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:40.462120 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a1f18831-1972-4c82-bd05-acf53009f068 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:40.463102 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a1f18831-1972-4c82-bd05-acf53009f068 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:40.463552 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a1f18831-1972-4c82-bd05-acf53009f068 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:40.657428 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-fd184175-758b-47d2-93ff-ac40807749d3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:40.664340 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a1f18831-1972-4c82-bd05-acf53009f068 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:40.665004 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-fd184175-758b-47d2-93ff-ac40807749d3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.217841 May 17 17:23:40.665571 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 146/285] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:40 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:40.671835 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a1f18831-1972-4c82-bd05-acf53009f068 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08" status: 200 len: 1314 microversion: 2.1 time: 0.221686 May 17 17:23:40.672385 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 140/286] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:40 2022] GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:23:41.682787 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c54089a0-e76f-4447-afc1-2d6dfde07177 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:41.682787 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c54089a0-e76f-4447-afc1-2d6dfde07177 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:41.688927 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-afe24bdd-1269-490e-bd77-c35c9c1cc01b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:41.689377 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c54089a0-e76f-4447-afc1-2d6dfde07177 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:41.689840 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-afe24bdd-1269-490e-bd77-c35c9c1cc01b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: 1b81b065-e5af-42ff-ab02-a137db1a1f08] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:41.690107 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c54089a0-e76f-4447-afc1-2d6dfde07177 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:41.690915 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c54089a0-e76f-4447-afc1-2d6dfde07177 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:41.691475 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c54089a0-e76f-4447-afc1-2d6dfde07177 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:41.697156 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-afe24bdd-1269-490e-bd77-c35c9c1cc01b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:41.698241 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-afe24bdd-1269-490e-bd77-c35c9c1cc01b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:41.699975 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-afe24bdd-1269-490e-bd77-c35c9c1cc01b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:41.700741 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-afe24bdd-1269-490e-bd77-c35c9c1cc01b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:41.912298 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c54089a0-e76f-4447-afc1-2d6dfde07177 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:41.915997 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-afe24bdd-1269-490e-bd77-c35c9c1cc01b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:41.925692 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c54089a0-e76f-4447-afc1-2d6dfde07177 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.248157 May 17 17:23:41.928520 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 147/287] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:41 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:41.929681 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-afe24bdd-1269-490e-bd77-c35c9c1cc01b tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08" status: 200 len: 1497 microversion: 2.1 time: 0.245186 May 17 17:23:41.941254 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 141/288] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:41 2022] GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08 => generated 1497 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:23:42.943876 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8f1280b3-1a40-4581-8995-0795c553c107 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:42.944538 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8f1280b3-1a40-4581-8995-0795c553c107 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:42.950374 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8f1280b3-1a40-4581-8995-0795c553c107 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:42.951001 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8f1280b3-1a40-4581-8995-0795c553c107 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:42.951812 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8f1280b3-1a40-4581-8995-0795c553c107 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:42.952272 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8f1280b3-1a40-4581-8995-0795c553c107 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:43.070909 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3ad9b663-c4d8-4150-924b-54c536d7b6f6 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:43.071435 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3ad9b663-c4d8-4150-924b-54c536d7b6f6 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: 1b81b065-e5af-42ff-ab02-a137db1a1f08] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:43.077973 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3ad9b663-c4d8-4150-924b-54c536d7b6f6 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:43.078422 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3ad9b663-c4d8-4150-924b-54c536d7b6f6 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:43.079205 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3ad9b663-c4d8-4150-924b-54c536d7b6f6 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:43.079669 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3ad9b663-c4d8-4150-924b-54c536d7b6f6 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:43.088241 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8f1280b3-1a40-4581-8995-0795c553c107 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:43.096361 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8f1280b3-1a40-4581-8995-0795c553c107 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.156253 May 17 17:23:43.096930 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 148/289] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:42 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:43.109844 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3ad9b663-c4d8-4150-924b-54c536d7b6f6 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: 1b81b065-e5af-42ff-ab02-a137db1a1f08] Going to try to terminate instance {{(pid=117611) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:23:43.400318 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3ad9b663-c4d8-4150-924b-54c536d7b6f6 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "DELETE /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08" status: 204 len: 0 microversion: 2.1 time: 0.332909 May 17 17:23:43.401024 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 142/290] 10.222.0.88 () {58 vars in 1238 bytes} [Tue May 17 17:23:43 2022] DELETE /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 17 17:23:43.410186 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a86cc65c-771c-4b22-90fe-d0c1d3be5202 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:43.410809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a86cc65c-771c-4b22-90fe-d0c1d3be5202 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: 1b81b065-e5af-42ff-ab02-a137db1a1f08] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:43.416649 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a86cc65c-771c-4b22-90fe-d0c1d3be5202 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:43.417094 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a86cc65c-771c-4b22-90fe-d0c1d3be5202 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:43.417884 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a86cc65c-771c-4b22-90fe-d0c1d3be5202 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:43.418315 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a86cc65c-771c-4b22-90fe-d0c1d3be5202 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:43.544712 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a86cc65c-771c-4b22-90fe-d0c1d3be5202 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:43.552605 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a86cc65c-771c-4b22-90fe-d0c1d3be5202 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08" status: 200 len: 1503 microversion: 2.1 time: 0.146847 May 17 17:23:43.553369 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 149/291] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:43 2022] GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08 => generated 1503 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:44.113894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-636dd4af-59f2-4171-bf3e-32d7a3751cdb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:44.114614 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-636dd4af-59f2-4171-bf3e-32d7a3751cdb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:44.120845 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-636dd4af-59f2-4171-bf3e-32d7a3751cdb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:44.121292 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-636dd4af-59f2-4171-bf3e-32d7a3751cdb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:44.122050 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-636dd4af-59f2-4171-bf3e-32d7a3751cdb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:44.122484 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-636dd4af-59f2-4171-bf3e-32d7a3751cdb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:44.251535 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-636dd4af-59f2-4171-bf3e-32d7a3751cdb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:44.258924 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-636dd4af-59f2-4171-bf3e-32d7a3751cdb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.149319 May 17 17:23:44.259488 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 143/292] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:44 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:44.570513 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8e947cb7-3983-4dd8-993c-5cbe8fe55678 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:44.571133 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8e947cb7-3983-4dd8-993c-5cbe8fe55678 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: 1b81b065-e5af-42ff-ab02-a137db1a1f08] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:44.576842 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8e947cb7-3983-4dd8-993c-5cbe8fe55678 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:44.577284 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8e947cb7-3983-4dd8-993c-5cbe8fe55678 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:44.578670 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8e947cb7-3983-4dd8-993c-5cbe8fe55678 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:44.579104 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8e947cb7-3983-4dd8-993c-5cbe8fe55678 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:44.710280 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8e947cb7-3983-4dd8-993c-5cbe8fe55678 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:44.717659 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8e947cb7-3983-4dd8-993c-5cbe8fe55678 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08" status: 200 len: 1503 microversion: 2.1 time: 0.150902 May 17 17:23:44.722691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 150/293] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:44 2022] GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:45.278128 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e871d6ab-1a7a-4f9d-a125-4656ccf2a9ee tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:45.278734 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e871d6ab-1a7a-4f9d-a125-4656ccf2a9ee tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:45.287267 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e871d6ab-1a7a-4f9d-a125-4656ccf2a9ee tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:45.287784 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e871d6ab-1a7a-4f9d-a125-4656ccf2a9ee tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:45.288565 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e871d6ab-1a7a-4f9d-a125-4656ccf2a9ee tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:45.289955 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e871d6ab-1a7a-4f9d-a125-4656ccf2a9ee tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:45.436997 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e871d6ab-1a7a-4f9d-a125-4656ccf2a9ee tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:45.445862 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e871d6ab-1a7a-4f9d-a125-4656ccf2a9ee tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.172951 May 17 17:23:45.450853 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 144/294] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:45 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:45.734254 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a4ded9e7-a81d-44ec-b33f-8d493676d6b5 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:45.735093 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a4ded9e7-a81d-44ec-b33f-8d493676d6b5 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: 1b81b065-e5af-42ff-ab02-a137db1a1f08] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:45.740978 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a4ded9e7-a81d-44ec-b33f-8d493676d6b5 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:45.741435 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a4ded9e7-a81d-44ec-b33f-8d493676d6b5 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:45.742202 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a4ded9e7-a81d-44ec-b33f-8d493676d6b5 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:45.742640 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a4ded9e7-a81d-44ec-b33f-8d493676d6b5 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:45.887386 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a4ded9e7-a81d-44ec-b33f-8d493676d6b5 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:45.896595 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a4ded9e7-a81d-44ec-b33f-8d493676d6b5 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08" status: 200 len: 1503 microversion: 2.1 time: 0.165220 May 17 17:23:45.897897 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 151/295] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:45 2022] GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08 => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:45.972064 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d8568df6-034c-4fa3-a403-5bd826ddd46d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-338461321", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-733781755", "security_groups": [{"name": "tempest-secgroup-smoke-240798546"}], "networks": [{"uuid": "40b5b6db-74f8-49ea-bc88-aeacc240dc42"}], "block_device_mapping_v2": [{"uuid": "1324eac0-615c-4dfa-9b06-f861c455b065", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:23:46.085139 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.network.neutron [None req-d8568df6-034c-4fa3-a403-5bd826ddd46d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] validate_networks() for [('40b5b6db-74f8-49ea-bc88-aeacc240dc42', None, None, None, None, None)] {{(pid=117611) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:23:46.387893 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-0e2a5f47-cfca-4cc6-af0e-e1c7539a624a req-2696470b-50ed-4992-9c23-b107bbcc3159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b81b065-e5af-42ff-ab02-a137db1a1f08", "name": "network-vif-deleted", "tag": "61eeae45-2af1-4e47-9cfe-927a2bda1c4b"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:23:46.396701 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-0e2a5f47-cfca-4cc6-af0e-e1c7539a624a req-2696470b-50ed-4992-9c23-b107bbcc3159 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:46.397262 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-0e2a5f47-cfca-4cc6-af0e-e1c7539a624a req-2696470b-50ed-4992-9c23-b107bbcc3159 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:46.409766 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-0e2a5f47-cfca-4cc6-af0e-e1c7539a624a req-2696470b-50ed-4992-9c23-b107bbcc3159 service nova] Creating event network-vif-deleted:61eeae45-2af1-4e47-9cfe-927a2bda1c4b for instance 1b81b065-e5af-42ff-ab02-a137db1a1f08 on hv-cinder-84214 May 17 17:23:46.415371 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-0e2a5f47-cfca-4cc6-af0e-e1c7539a624a req-2696470b-50ed-4992-9c23-b107bbcc3159 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030883 May 17 17:23:46.416179 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 152/296] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:23:46.469106 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-60e4f77e-300a-4442-b819-1a7944c862e0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:46.472611 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-60e4f77e-300a-4442-b819-1a7944c862e0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:46.483198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-60e4f77e-300a-4442-b819-1a7944c862e0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:46.483688 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-60e4f77e-300a-4442-b819-1a7944c862e0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:46.484667 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-60e4f77e-300a-4442-b819-1a7944c862e0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:46.485301 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-60e4f77e-300a-4442-b819-1a7944c862e0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:46.497059 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-d8568df6-034c-4fa3-a403-5bd826ddd46d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Flavor limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:23:46.497519 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-d8568df6-034c-4fa3-a403-5bd826ddd46d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Image limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:23:46.498002 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-d8568df6-034c-4fa3-a403-5bd826ddd46d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Flavor pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:23:46.498549 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-d8568df6-034c-4fa3-a403-5bd826ddd46d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Image pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:23:46.498963 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-d8568df6-034c-4fa3-a403-5bd826ddd46d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:23:46.510357 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d8568df6-034c-4fa3-a403-5bd826ddd46d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:46.510814 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d8568df6-034c-4fa3-a403-5bd826ddd46d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:46.513539 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d8568df6-034c-4fa3-a403-5bd826ddd46d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:46.513539 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d8568df6-034c-4fa3-a403-5bd826ddd46d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:46.530178 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-d8568df6-034c-4fa3-a403-5bd826ddd46d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Getting quotas for project 60e4a7b9a0a74c2788facfa3035fc8ab. Resources: {'cores', 'ram', 'instances'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:23:46.534229 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-d8568df6-034c-4fa3-a403-5bd826ddd46d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Getting quotas for user 0d565f5725984bf6908fd35b557f8736 and project 60e4a7b9a0a74c2788facfa3035fc8ab. Resources: {'cores', 'ram', 'instances'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:23:46.604556 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d8568df6-034c-4fa3-a403-5bd826ddd46d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Going to run 1 instances... {{(pid=117611) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:23:46.606903 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d8568df6-034c-4fa3-a403-5bd826ddd46d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1324eac0-615c-4dfa-9b06-f861c455b065',volume_size=None,volume_type=None)] {{(pid=117611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:23:46.661582 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-60e4f77e-300a-4442-b819-1a7944c862e0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:46.669988 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-60e4f77e-300a-4442-b819-1a7944c862e0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1522 microversion: 2.1 time: 0.210812 May 17 17:23:46.670661 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 153/297] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:46 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:46.915007 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7f276d69-ea77-43d6-ae28-694421e23325 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:46.916378 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-7f276d69-ea77-43d6-ae28-694421e23325 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: 1b81b065-e5af-42ff-ab02-a137db1a1f08] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:46.922826 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7f276d69-ea77-43d6-ae28-694421e23325 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:46.923340 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7f276d69-ea77-43d6-ae28-694421e23325 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:46.924210 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7f276d69-ea77-43d6-ae28-694421e23325 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:46.924649 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7f276d69-ea77-43d6-ae28-694421e23325 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:46.985193 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7f276d69-ea77-43d6-ae28-694421e23325 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:46.992962 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7f276d69-ea77-43d6-ae28-694421e23325 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08" status: 200 len: 1299 microversion: 2.1 time: 0.082582 May 17 17:23:46.993527 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 154/298] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:46 2022] GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08 => generated 1299 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:23:47.112029 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d8568df6-034c-4fa3-a403-5bd826ddd46d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.144422 May 17 17:23:47.112671 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 145/299] 10.222.0.88 () {60 vars in 1146 bytes} [Tue May 17 17:23:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 1146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:23:47.122459 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-73fbebf3-2571-4c23-b722-16078aca3b51 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:47.123067 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-73fbebf3-2571-4c23-b722-16078aca3b51 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:47.190986 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-73fbebf3-2571-4c23-b722-16078aca3b51 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d565f5725984bf6908fd35b557f8736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e4a7b9a0a74c2788facfa3035fc8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:47.199595 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-73fbebf3-2571-4c23-b722-16078aca3b51 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37" status: 200 len: 1087 microversion: 2.1 time: 0.080852 May 17 17:23:47.209335 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 155/300] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:47 2022] GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 => generated 1087 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:47.686521 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d53d65a7-16f5-4e36-a1a2-bc4da950bf06 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:47.687161 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d53d65a7-16f5-4e36-a1a2-bc4da950bf06 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:47.693794 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d53d65a7-16f5-4e36-a1a2-bc4da950bf06 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:47.694132 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d53d65a7-16f5-4e36-a1a2-bc4da950bf06 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:47.694971 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d53d65a7-16f5-4e36-a1a2-bc4da950bf06 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:47.695342 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d53d65a7-16f5-4e36-a1a2-bc4da950bf06 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:47.837310 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d53d65a7-16f5-4e36-a1a2-bc4da950bf06 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:47.845498 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d53d65a7-16f5-4e36-a1a2-bc4da950bf06 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1502 microversion: 2.1 time: 0.163250 May 17 17:23:47.846063 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 146/301] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:47 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:47.861329 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-aec7ff06-b382-4b7d-bdac-b1b8f601c5bf tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:47.861939 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-aec7ff06-b382-4b7d-bdac-b1b8f601c5bf tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:47.867735 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-aec7ff06-b382-4b7d-bdac-b1b8f601c5bf tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:47.868128 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-aec7ff06-b382-4b7d-bdac-b1b8f601c5bf tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:47.868892 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-aec7ff06-b382-4b7d-bdac-b1b8f601c5bf tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:47.869326 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-aec7ff06-b382-4b7d-bdac-b1b8f601c5bf tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:48.011439 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-862432d6-967f-44d0-8c11-8298340a25c9 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:48.012091 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-862432d6-967f-44d0-8c11-8298340a25c9 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: 1b81b065-e5af-42ff-ab02-a137db1a1f08] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:48.014157 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-aec7ff06-b382-4b7d-bdac-b1b8f601c5bf tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:48.022012 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-862432d6-967f-44d0-8c11-8298340a25c9 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:48.022469 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-862432d6-967f-44d0-8c11-8298340a25c9 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:48.023629 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-862432d6-967f-44d0-8c11-8298340a25c9 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:48.024224 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-862432d6-967f-44d0-8c11-8298340a25c9 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:48.026261 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-aec7ff06-b382-4b7d-bdac-b1b8f601c5bf tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1517 microversion: 2.1 time: 0.168647 May 17 17:23:48.027257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 156/302] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:47 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:48.073131 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-862432d6-967f-44d0-8c11-8298340a25c9 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:48.074128 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-862432d6-967f-44d0-8c11-8298340a25c9 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:48.074878 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.objects.instance [None req-862432d6-967f-44d0-8c11-8298340a25c9 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lazy-loading 'fault' on Instance uuid 1b81b065-e5af-42ff-ab02-a137db1a1f08 {{(pid=117611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:23:48.128627 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-862432d6-967f-44d0-8c11-8298340a25c9 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dedebb1073a43109e45a3d73a8bc62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f914985c201429e845986b973e37490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:48.138457 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-862432d6-967f-44d0-8c11-8298340a25c9 tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08" status: 200 len: 1304 microversion: 2.1 time: 0.132166 May 17 17:23:48.139039 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 147/303] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:48 2022] GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08 => generated 1304 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:23:48.216630 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e9285599-a9b7-43ce-9d5f-369e85abe29d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:48.217244 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e9285599-a9b7-43ce-9d5f-369e85abe29d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:48.223540 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e9285599-a9b7-43ce-9d5f-369e85abe29d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:48.224004 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e9285599-a9b7-43ce-9d5f-369e85abe29d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:48.224786 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e9285599-a9b7-43ce-9d5f-369e85abe29d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:48.225324 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e9285599-a9b7-43ce-9d5f-369e85abe29d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:48.316678 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e9285599-a9b7-43ce-9d5f-369e85abe29d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d565f5725984bf6908fd35b557f8736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e4a7b9a0a74c2788facfa3035fc8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:48.326108 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e9285599-a9b7-43ce-9d5f-369e85abe29d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37" status: 200 len: 1137 microversion: 2.1 time: 0.113203 May 17 17:23:48.326991 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 157/304] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:48 2022] GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 => generated 1137 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:49.159974 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-bcb900da-8474-412f-904c-3aca771e5e8e tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:49.160432 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-bcb900da-8474-412f-904c-3aca771e5e8e tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] [instance: 1b81b065-e5af-42ff-ab02-a137db1a1f08] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:49.166933 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bcb900da-8474-412f-904c-3aca771e5e8e tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:49.167385 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bcb900da-8474-412f-904c-3aca771e5e8e tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:49.168191 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bcb900da-8474-412f-904c-3aca771e5e8e tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:49.168698 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bcb900da-8474-412f-904c-3aca771e5e8e tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:49.184829 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-bcb900da-8474-412f-904c-3aca771e5e8e tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] HTTP exception thrown: Instance 1b81b065-e5af-42ff-ab02-a137db1a1f08 could not be found. May 17 17:23:49.186450 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-bcb900da-8474-412f-904c-3aca771e5e8e tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Request method failure captured: May 17 17:23:49.186450 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08 HTTP/1.1 May 17 17:23:49.186450 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:23:49.186450 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:23:49.186450 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:23:49.186450 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:23:49.186450 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:23:49.186450 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:23:49.186450 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:23:49.186450 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:23:49.186450 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9nsOSWdRIPDuDWvfKGF6m9UoWtYzEBziZ5bWddoN9ygg8OKf_NjI_TP_wq_KpN1M0u_ObJtPrgbAwjaJEwRw_Zla4GN1sj2XwZNxTZnhdAnLCFF27AedkRl7dhzXQVk1dpgj6EBn_tsEoGfjFr0rlYbsgwXBUdb1W52NFoLFCf1uW4 May 17 17:23:49.186450 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:23:49.186450 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:23:49.186450 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:23:49.186450 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:23:49.186450 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:23:49.186450 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:23:49.186450 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: 0f914985c201429e845986b973e37490 May 17 17:23:49.186450 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-VolumesActionsTest-1287484978 May 17 17:23:49.186450 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:23:49.186450 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:23:49.188593 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0f914985c201429e845986b973e37490"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0f914985c201429e845986b973e37490"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0f914985c201429e845986b973e37490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0f914985c201429e845986b973e37490", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:23:49.188593 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-VolumesActionsTest-1287484978 May 17 17:23:49.188593 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: 0f914985c201429e845986b973e37490 May 17 17:23:49.188593 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-VolumesActionsTest-1287484978 May 17 17:23:49.188593 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-VolumesActionsTest-1287484978-project May 17 17:23:49.188593 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:23:49.188593 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:23:49.188593 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 3dedebb1073a43109e45a3d73a8bc62f May 17 17:23:49.188593 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-VolumesActionsTest-1287484978-project May 17 17:23:49.188593 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:23:49.188593 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Instance 1b81b065-e5af-42ff-ab02-a137db1a1f08 could not be found. May 17 17:23:49.188593 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': '1b81b065-e5af-42ff-ab02-a137db1a1f08'} May 17 17:23:49.189421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:23:49.189421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:23:49.189421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:23:49.189421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:23:49.189421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:23:49.189421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:23:49.189421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:23:49.189421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:23:49.189421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:23:49.189421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:23:49.189421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b81b065-e5af-42ff-ab02-a137db1a1f08 could not be found. May 17 17:23:49.189421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:23:49.189421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:23:49.189421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:23:49.189421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:23:49.189421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:23:49.189421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:23:49.189421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:23:49.189421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:23:49.189421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:23:49.190852 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:23:49.190852 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:23:49.190852 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:23:49.190852 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:23:49.190852 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:23:49.190852 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:23:49.190852 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:23:49.190852 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b81b065-e5af-42ff-ab02-a137db1a1f08 could not be found. May 17 17:23:49.190852 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:23:49.190852 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:23:49.190852 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:23:49.190852 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:23:49.190852 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:23:49.190852 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:23:49.190852 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:23:49.190852 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:23:49.190852 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b81b065-e5af-42ff-ab02-a137db1a1f08 could not be found. May 17 17:23:49.190852 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:23:49.193076 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-bcb900da-8474-412f-904c-3aca771e5e8e tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] Returning 404 to user: Instance 1b81b065-e5af-42ff-ab02-a137db1a1f08 could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:23:49.193076 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-bcb900da-8474-412f-904c-3aca771e5e8e tempest-VolumesActionsTest-1287484978 tempest-VolumesActionsTest-1287484978-project] 10.222.0.88 "GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08" status: 404 len: 111 microversion: 2.1 time: 0.032830 May 17 17:23:49.193076 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 148/305] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:49 2022] GET /compute/v2.1/servers/1b81b065-e5af-42ff-ab02-a137db1a1f08 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:23:49.344422 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3ac720e5-c5cf-4093-8b4f-b987c0fd8fc1 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:49.345488 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3ac720e5-c5cf-4093-8b4f-b987c0fd8fc1 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:49.352089 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3ac720e5-c5cf-4093-8b4f-b987c0fd8fc1 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:49.352699 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3ac720e5-c5cf-4093-8b4f-b987c0fd8fc1 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:49.353738 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3ac720e5-c5cf-4093-8b4f-b987c0fd8fc1 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:49.354239 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3ac720e5-c5cf-4093-8b4f-b987c0fd8fc1 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:49.440863 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-3ac720e5-c5cf-4093-8b4f-b987c0fd8fc1 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d565f5725984bf6908fd35b557f8736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e4a7b9a0a74c2788facfa3035fc8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:49.448388 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3ac720e5-c5cf-4093-8b4f-b987c0fd8fc1 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37" status: 200 len: 1185 microversion: 2.1 time: 0.109098 May 17 17:23:49.449123 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 158/306] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:49 2022] GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 => generated 1185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:49.854134 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c4474930-9134-4666-abdf-f4c828e73253 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:23:49.855210 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c4474930-9134-4666-abdf-f4c828e73253 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:49.862088 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c4474930-9134-4666-abdf-f4c828e73253 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:49.862952 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c4474930-9134-4666-abdf-f4c828e73253 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:49.863853 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c4474930-9134-4666-abdf-f4c828e73253 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:49.864358 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c4474930-9134-4666-abdf-f4c828e73253 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:49.887292 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.objects.instance [None req-c4474930-9134-4666-abdf-f4c828e73253 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lazy-loading 'flavor' on Instance uuid 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d {{(pid=117611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:23:50.195734 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c4474930-9134-4666-abdf-f4c828e73253 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "POST /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d/action" status: 200 len: 32 microversion: 2.1 time: 0.345646 May 17 17:23:50.196940 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 149/307] 10.222.0.88 () {60 vars in 1277 bytes} [Tue May 17 17:23:49 2022] POST /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d/action => generated 32 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 17:23:50.206067 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5b88ecc6-ad4b-43fd-a460-565a835d181f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:50.206680 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5b88ecc6-ad4b-43fd-a460-565a835d181f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:50.214759 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5b88ecc6-ad4b-43fd-a460-565a835d181f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:50.215934 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5b88ecc6-ad4b-43fd-a460-565a835d181f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:50.216554 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5b88ecc6-ad4b-43fd-a460-565a835d181f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:50.217286 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5b88ecc6-ad4b-43fd-a460-565a835d181f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:50.397817 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5b88ecc6-ad4b-43fd-a460-565a835d181f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:50.422605 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5b88ecc6-ad4b-43fd-a460-565a835d181f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1523 microversion: 2.1 time: 0.220407 May 17 17:23:50.423537 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 159/308] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:50 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:50.467137 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ad2918b0-af4a-469e-bfd1-60c9ffde88bb tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:50.467992 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ad2918b0-af4a-469e-bfd1-60c9ffde88bb tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:50.474564 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ad2918b0-af4a-469e-bfd1-60c9ffde88bb tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:50.475268 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ad2918b0-af4a-469e-bfd1-60c9ffde88bb tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:50.476129 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ad2918b0-af4a-469e-bfd1-60c9ffde88bb tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:50.476561 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ad2918b0-af4a-469e-bfd1-60c9ffde88bb tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:50.618801 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ad2918b0-af4a-469e-bfd1-60c9ffde88bb tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d565f5725984bf6908fd35b557f8736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e4a7b9a0a74c2788facfa3035fc8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:50.627567 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ad2918b0-af4a-469e-bfd1-60c9ffde88bb tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37" status: 200 len: 1270 microversion: 2.1 time: 0.164985 May 17 17:23:50.628144 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 150/309] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:50 2022] GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:51.139792 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-259e2ab5-53d5-4121-86d7-fabdb376d693 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:51.140306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-259e2ab5-53d5-4121-86d7-fabdb376d693 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:51.146553 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-259e2ab5-53d5-4121-86d7-fabdb376d693 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:51.147005 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-259e2ab5-53d5-4121-86d7-fabdb376d693 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:51.147874 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-259e2ab5-53d5-4121-86d7-fabdb376d693 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:51.150778 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-259e2ab5-53d5-4121-86d7-fabdb376d693 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:51.170965 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-259e2ab5-53d5-4121-86d7-fabdb376d693 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f/ips" status: 200 len: 144 microversion: 2.1 time: 0.034960 May 17 17:23:51.174153 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 160/310] 10.222.0.88 () {58 vars in 1247 bytes} [Tue May 17 17:23:51 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f/ips => generated 144 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:23:51.441149 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-65a2faa2-2d07-4f1f-89b5-f51cd5bb6f2b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:51.441704 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-65a2faa2-2d07-4f1f-89b5-f51cd5bb6f2b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:51.448215 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65a2faa2-2d07-4f1f-89b5-f51cd5bb6f2b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:51.448668 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65a2faa2-2d07-4f1f-89b5-f51cd5bb6f2b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:51.449541 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65a2faa2-2d07-4f1f-89b5-f51cd5bb6f2b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:51.449977 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65a2faa2-2d07-4f1f-89b5-f51cd5bb6f2b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:51.608455 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-65a2faa2-2d07-4f1f-89b5-f51cd5bb6f2b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:51.618283 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-65a2faa2-2d07-4f1f-89b5-f51cd5bb6f2b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1523 microversion: 2.1 time: 0.181603 May 17 17:23:51.628606 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 151/311] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:51 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:51.644788 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ff51f853-04ba-4b5b-9072-809a8710035d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:51.645515 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ff51f853-04ba-4b5b-9072-809a8710035d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:51.651505 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ff51f853-04ba-4b5b-9072-809a8710035d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:51.652066 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ff51f853-04ba-4b5b-9072-809a8710035d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:51.652920 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ff51f853-04ba-4b5b-9072-809a8710035d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:51.653429 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ff51f853-04ba-4b5b-9072-809a8710035d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:51.788668 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ff51f853-04ba-4b5b-9072-809a8710035d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d565f5725984bf6908fd35b557f8736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e4a7b9a0a74c2788facfa3035fc8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:51.795879 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ff51f853-04ba-4b5b-9072-809a8710035d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37" status: 200 len: 1270 microversion: 2.1 time: 0.154950 May 17 17:23:51.796439 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 161/312] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:51 2022] GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:52.636340 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-25d4e7b5-7065-4504-a32f-53a2542c512a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:52.636952 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-25d4e7b5-7065-4504-a32f-53a2542c512a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:52.643936 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-25d4e7b5-7065-4504-a32f-53a2542c512a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:52.644426 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-25d4e7b5-7065-4504-a32f-53a2542c512a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:52.645202 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-25d4e7b5-7065-4504-a32f-53a2542c512a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:52.645638 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-25d4e7b5-7065-4504-a32f-53a2542c512a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:52.774407 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-25d4e7b5-7065-4504-a32f-53a2542c512a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:52.782409 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-25d4e7b5-7065-4504-a32f-53a2542c512a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1523 microversion: 2.1 time: 0.150399 May 17 17:23:52.782972 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 152/313] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:52 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:52.813002 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-399f6edf-9edf-4eb2-b813-22b560194292 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:52.813604 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-399f6edf-9edf-4eb2-b813-22b560194292 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:52.819367 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-399f6edf-9edf-4eb2-b813-22b560194292 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:52.819838 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-399f6edf-9edf-4eb2-b813-22b560194292 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:52.820632 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-399f6edf-9edf-4eb2-b813-22b560194292 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:52.821062 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-399f6edf-9edf-4eb2-b813-22b560194292 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:52.947559 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-399f6edf-9edf-4eb2-b813-22b560194292 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d565f5725984bf6908fd35b557f8736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e4a7b9a0a74c2788facfa3035fc8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:52.955279 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-399f6edf-9edf-4eb2-b813-22b560194292 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37" status: 200 len: 1270 microversion: 2.1 time: 0.146044 May 17 17:23:52.956586 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 162/314] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:52 2022] GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 => generated 1270 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:53.799051 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-bfeb442c-aa9b-44b1-b126-ab06d0a8196f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:53.799685 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-bfeb442c-aa9b-44b1-b126-ab06d0a8196f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:53.805857 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bfeb442c-aa9b-44b1-b126-ab06d0a8196f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:53.806310 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bfeb442c-aa9b-44b1-b126-ab06d0a8196f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:53.807083 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bfeb442c-aa9b-44b1-b126-ab06d0a8196f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:53.807564 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bfeb442c-aa9b-44b1-b126-ab06d0a8196f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:53.860312 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-12d4d924-8993-4465-b520-0e7bea00ef9b req-96c87278-b4c9-411a-9203-1875bc31f35d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bf11f0d-a455-430a-b320-5163e1b98b37", "tag": "78dcbc08-7968-4aa1-95fa-f2034bb56aae"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:23:53.860312 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-12d4d924-8993-4465-b520-0e7bea00ef9b req-96c87278-b4c9-411a-9203-1875bc31f35d service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:53.860312 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-12d4d924-8993-4465-b520-0e7bea00ef9b req-96c87278-b4c9-411a-9203-1875bc31f35d service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:53.887876 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-12d4d924-8993-4465-b520-0e7bea00ef9b req-96c87278-b4c9-411a-9203-1875bc31f35d service nova] Creating event network-changed:78dcbc08-7968-4aa1-95fa-f2034bb56aae for instance 9bf11f0d-a455-430a-b320-5163e1b98b37 on hv-cinder-84214 May 17 17:23:53.895806 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-12d4d924-8993-4465-b520-0e7bea00ef9b req-96c87278-b4c9-411a-9203-1875bc31f35d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048886 May 17 17:23:53.896905 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 163/315] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:23:53.944313 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-bfeb442c-aa9b-44b1-b126-ab06d0a8196f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:53.951760 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-bfeb442c-aa9b-44b1-b126-ab06d0a8196f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1523 microversion: 2.1 time: 0.156365 May 17 17:23:53.952329 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 153/316] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:53 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:53.974046 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6406f37b-817f-405e-8f1f-f5b851cee70a tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:53.974772 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6406f37b-817f-405e-8f1f-f5b851cee70a tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:53.981007 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6406f37b-817f-405e-8f1f-f5b851cee70a tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:53.981455 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6406f37b-817f-405e-8f1f-f5b851cee70a tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:53.982228 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6406f37b-817f-405e-8f1f-f5b851cee70a tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:53.982660 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6406f37b-817f-405e-8f1f-f5b851cee70a tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:54.120911 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6406f37b-817f-405e-8f1f-f5b851cee70a tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d565f5725984bf6908fd35b557f8736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e4a7b9a0a74c2788facfa3035fc8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:54.130741 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6406f37b-817f-405e-8f1f-f5b851cee70a tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37" status: 200 len: 1270 microversion: 2.1 time: 0.160778 May 17 17:23:54.131828 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 164/317] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:53 2022] GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 => generated 1270 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:54.968977 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4304cb3a-ee2c-4108-a4db-f640fc5ac681 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:54.969692 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4304cb3a-ee2c-4108-a4db-f640fc5ac681 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:54.975830 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4304cb3a-ee2c-4108-a4db-f640fc5ac681 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:54.976275 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4304cb3a-ee2c-4108-a4db-f640fc5ac681 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:54.977031 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4304cb3a-ee2c-4108-a4db-f640fc5ac681 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:54.977466 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4304cb3a-ee2c-4108-a4db-f640fc5ac681 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:55.083040 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8ca7ee2a-78e5-446d-adc3-6f2de68b65ae tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:55.083577 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8ca7ee2a-78e5-446d-adc3-6f2de68b65ae tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:55.089535 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8ca7ee2a-78e5-446d-adc3-6f2de68b65ae tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:55.089988 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8ca7ee2a-78e5-446d-adc3-6f2de68b65ae tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:55.090758 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8ca7ee2a-78e5-446d-adc3-6f2de68b65ae tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:55.091195 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8ca7ee2a-78e5-446d-adc3-6f2de68b65ae tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:55.111269 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4304cb3a-ee2c-4108-a4db-f640fc5ac681 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:55.113952 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8ca7ee2a-78e5-446d-adc3-6f2de68b65ae tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44/ips" status: 200 len: 152 microversion: 2.20 time: 0.034753 May 17 17:23:55.114769 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 165/318] 10.222.0.88 () {60 vars in 1288 bytes} [Tue May 17 17:23:55 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44/ips => generated 152 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 17:23:55.119038 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4304cb3a-ee2c-4108-a4db-f640fc5ac681 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1523 microversion: 2.1 time: 0.153824 May 17 17:23:55.123568 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 154/319] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:54 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:55.171259 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0f5d84a5-0175-4ef7-97e8-0feddf377a39 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:55.171259 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0f5d84a5-0175-4ef7-97e8-0feddf377a39 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:55.171259 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0f5d84a5-0175-4ef7-97e8-0feddf377a39 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:55.171259 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0f5d84a5-0175-4ef7-97e8-0feddf377a39 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:55.172162 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0f5d84a5-0175-4ef7-97e8-0feddf377a39 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:55.172162 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0f5d84a5-0175-4ef7-97e8-0feddf377a39 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:55.301954 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0f5d84a5-0175-4ef7-97e8-0feddf377a39 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d565f5725984bf6908fd35b557f8736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e4a7b9a0a74c2788facfa3035fc8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:55.309159 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0f5d84a5-0175-4ef7-97e8-0feddf377a39 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37" status: 200 len: 1270 microversion: 2.1 time: 0.163027 May 17 17:23:55.309710 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 166/320] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:55 2022] GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:56.139966 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a5164319-c6fd-47e1-8393-359f122552e9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:56.141506 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a5164319-c6fd-47e1-8393-359f122552e9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:56.149788 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a5164319-c6fd-47e1-8393-359f122552e9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:56.150238 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a5164319-c6fd-47e1-8393-359f122552e9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:56.151684 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a5164319-c6fd-47e1-8393-359f122552e9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:56.152305 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a5164319-c6fd-47e1-8393-359f122552e9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:56.328045 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-701941b5-c78e-4edc-a9cc-0a67d43d8975 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:56.333436 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-701941b5-c78e-4edc-a9cc-0a67d43d8975 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:56.336408 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-701941b5-c78e-4edc-a9cc-0a67d43d8975 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:56.339426 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-701941b5-c78e-4edc-a9cc-0a67d43d8975 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:56.340280 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-701941b5-c78e-4edc-a9cc-0a67d43d8975 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:56.342351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-701941b5-c78e-4edc-a9cc-0a67d43d8975 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:56.500182 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a5164319-c6fd-47e1-8393-359f122552e9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:56.516396 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a5164319-c6fd-47e1-8393-359f122552e9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1523 microversion: 2.1 time: 0.376308 May 17 17:23:56.516396 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 155/321] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:56 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1523 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:23:56.719653 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-701941b5-c78e-4edc-a9cc-0a67d43d8975 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d565f5725984bf6908fd35b557f8736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e4a7b9a0a74c2788facfa3035fc8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:56.733276 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-701941b5-c78e-4edc-a9cc-0a67d43d8975 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37" status: 200 len: 1270 microversion: 2.1 time: 0.409671 May 17 17:23:56.733858 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 167/322] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:56 2022] GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 => generated 1270 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:23:57.120532 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ae207a13-aaa7-4d4e-9eb1-321ed81d06f0 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72582672-4a30-47a4-a7af-d3c40d659794"}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:23:57.123748 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ae207a13-aaa7-4d4e-9eb1-321ed81d06f0 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:57.128588 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ae207a13-aaa7-4d4e-9eb1-321ed81d06f0 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:57.131326 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ae207a13-aaa7-4d4e-9eb1-321ed81d06f0 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:57.137809 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ae207a13-aaa7-4d4e-9eb1-321ed81d06f0 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:57.138321 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ae207a13-aaa7-4d4e-9eb1-321ed81d06f0 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:57.532507 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e63448fd-8d50-4ac1-8556-efb04fbc2fbe tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:57.533112 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e63448fd-8d50-4ac1-8556-efb04fbc2fbe tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:57.539129 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e63448fd-8d50-4ac1-8556-efb04fbc2fbe tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:57.539540 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e63448fd-8d50-4ac1-8556-efb04fbc2fbe tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:57.540315 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e63448fd-8d50-4ac1-8556-efb04fbc2fbe tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:57.540772 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e63448fd-8d50-4ac1-8556-efb04fbc2fbe tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:57.709180 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e63448fd-8d50-4ac1-8556-efb04fbc2fbe tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:57.716562 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e63448fd-8d50-4ac1-8556-efb04fbc2fbe tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1523 microversion: 2.1 time: 0.188818 May 17 17:23:57.717137 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 168/323] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:57 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:23:57.755284 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c187180d-a4c5-4686-b2fe-cb09344b01fb tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:57.755941 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c187180d-a4c5-4686-b2fe-cb09344b01fb tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:57.762116 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c187180d-a4c5-4686-b2fe-cb09344b01fb tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:57.762567 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c187180d-a4c5-4686-b2fe-cb09344b01fb tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:57.763345 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c187180d-a4c5-4686-b2fe-cb09344b01fb tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:57.763912 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c187180d-a4c5-4686-b2fe-cb09344b01fb tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:57.938264 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c187180d-a4c5-4686-b2fe-cb09344b01fb tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d565f5725984bf6908fd35b557f8736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e4a7b9a0a74c2788facfa3035fc8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:57.938264 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c187180d-a4c5-4686-b2fe-cb09344b01fb tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37" status: 200 len: 1270 microversion: 2.1 time: 0.183954 May 17 17:23:57.938264 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 169/324] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:57 2022] GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 => generated 1270 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:23:58.407297 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ae207a13-aaa7-4d4e-9eb1-321ed81d06f0 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "POST /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.289551 May 17 17:23:58.428371 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 156/325] 10.222.0.88 () {60 vars in 1322 bytes} [Tue May 17 17:23:57 2022] POST /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f/os-volume_attachments => generated 194 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:23:58.744185 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b1940066-0ec4-4a5b-899e-46f2105117a2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:58.746733 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b1940066-0ec4-4a5b-899e-46f2105117a2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:58.764705 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b1940066-0ec4-4a5b-899e-46f2105117a2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:58.765826 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b1940066-0ec4-4a5b-899e-46f2105117a2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:58.766684 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b1940066-0ec4-4a5b-899e-46f2105117a2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:58.767327 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b1940066-0ec4-4a5b-899e-46f2105117a2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:58.948737 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-11b8d7d0-5eb2-4bfd-bab6-f309bdffcee7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:23:58.949410 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-11b8d7d0-5eb2-4bfd-bab6-f309bdffcee7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:58.964538 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-11b8d7d0-5eb2-4bfd-bab6-f309bdffcee7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:58.964538 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-11b8d7d0-5eb2-4bfd-bab6-f309bdffcee7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:58.975762 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-11b8d7d0-5eb2-4bfd-bab6-f309bdffcee7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:58.976513 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-11b8d7d0-5eb2-4bfd-bab6-f309bdffcee7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:59.055321 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.objects.instance [None req-11b8d7d0-5eb2-4bfd-bab6-f309bdffcee7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lazy-loading 'flavor' on Instance uuid bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 {{(pid=117611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:23:59.059264 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b1940066-0ec4-4a5b-899e-46f2105117a2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:59.069621 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b1940066-0ec4-4a5b-899e-46f2105117a2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1523 microversion: 2.1 time: 0.339857 May 17 17:23:59.070687 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 170/326] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:58 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1523 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:23:59.075822 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8776ac19-ab31-4cb3-ac75-e716004ee35c tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:23:59.076610 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8776ac19-ab31-4cb3-ac75-e716004ee35c tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:23:59.085082 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8776ac19-ab31-4cb3-ac75-e716004ee35c tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:59.099858 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8776ac19-ab31-4cb3-ac75-e716004ee35c tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:59.099858 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8776ac19-ab31-4cb3-ac75-e716004ee35c tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:23:59.099858 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8776ac19-ab31-4cb3-ac75-e716004ee35c tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:23:59.257458 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8776ac19-ab31-4cb3-ac75-e716004ee35c tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d565f5725984bf6908fd35b557f8736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e4a7b9a0a74c2788facfa3035fc8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:23:59.266540 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8776ac19-ab31-4cb3-ac75-e716004ee35c tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37" status: 200 len: 1258 microversion: 2.1 time: 0.193668 May 17 17:23:59.276589 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 171/327] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:23:59 2022] GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 => generated 1258 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:00.088733 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ac759e06-25a3-4ad9-a701-4bc39312da3e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:00.090113 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ac759e06-25a3-4ad9-a701-4bc39312da3e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:00.097178 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ac759e06-25a3-4ad9-a701-4bc39312da3e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:00.097621 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ac759e06-25a3-4ad9-a701-4bc39312da3e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:00.098681 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ac759e06-25a3-4ad9-a701-4bc39312da3e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:00.099278 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ac759e06-25a3-4ad9-a701-4bc39312da3e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:00.306586 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ac759e06-25a3-4ad9-a701-4bc39312da3e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:00.316794 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ac759e06-25a3-4ad9-a701-4bc39312da3e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1523 microversion: 2.1 time: 0.232831 May 17 17:24:00.329766 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 172/328] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:00 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:00.338011 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-16fd730d-d924-4c6f-a6be-878b0b54b737 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:00.338272 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-16fd730d-d924-4c6f-a6be-878b0b54b737 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:00.353236 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-16fd730d-d924-4c6f-a6be-878b0b54b737 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:00.354532 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-16fd730d-d924-4c6f-a6be-878b0b54b737 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:00.358801 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-16fd730d-d924-4c6f-a6be-878b0b54b737 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:00.359391 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-16fd730d-d924-4c6f-a6be-878b0b54b737 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:00.533658 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-16fd730d-d924-4c6f-a6be-878b0b54b737 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d565f5725984bf6908fd35b557f8736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e4a7b9a0a74c2788facfa3035fc8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:00.545250 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-16fd730d-d924-4c6f-a6be-878b0b54b737 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37" status: 200 len: 1258 microversion: 2.1 time: 0.213510 May 17 17:24:00.555907 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 173/329] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:00 2022] GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 => generated 1258 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:01.334220 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ea6928b9-b978-44ff-85c2-0c0d5468ccce tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:01.335651 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ea6928b9-b978-44ff-85c2-0c0d5468ccce tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:01.341970 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ea6928b9-b978-44ff-85c2-0c0d5468ccce tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:01.342438 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ea6928b9-b978-44ff-85c2-0c0d5468ccce tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:01.343263 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ea6928b9-b978-44ff-85c2-0c0d5468ccce tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:01.343729 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ea6928b9-b978-44ff-85c2-0c0d5468ccce tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:01.510978 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ea6928b9-b978-44ff-85c2-0c0d5468ccce tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:01.524007 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ea6928b9-b978-44ff-85c2-0c0d5468ccce tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1523 microversion: 2.1 time: 0.193802 May 17 17:24:01.524869 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 174/330] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:01 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:24:01.570399 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-cf136010-a9d6-4022-a16f-94e367ef17d2 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:01.571020 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-cf136010-a9d6-4022-a16f-94e367ef17d2 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:01.586414 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cf136010-a9d6-4022-a16f-94e367ef17d2 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:01.587070 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cf136010-a9d6-4022-a16f-94e367ef17d2 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:01.588889 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cf136010-a9d6-4022-a16f-94e367ef17d2 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:01.589389 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cf136010-a9d6-4022-a16f-94e367ef17d2 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:01.841701 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-cf136010-a9d6-4022-a16f-94e367ef17d2 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d565f5725984bf6908fd35b557f8736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e4a7b9a0a74c2788facfa3035fc8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:01.851225 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-cf136010-a9d6-4022-a16f-94e367ef17d2 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37" status: 200 len: 1258 microversion: 2.1 time: 0.284660 May 17 17:24:01.862544 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 175/331] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:01 2022] GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 => generated 1258 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:02.541523 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f7a161d3-9e6a-44b0-8e00-f97fc241249a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:02.542571 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f7a161d3-9e6a-44b0-8e00-f97fc241249a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:02.548414 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f7a161d3-9e6a-44b0-8e00-f97fc241249a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:02.549052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f7a161d3-9e6a-44b0-8e00-f97fc241249a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:02.550016 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f7a161d3-9e6a-44b0-8e00-f97fc241249a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:02.550463 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f7a161d3-9e6a-44b0-8e00-f97fc241249a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:02.716498 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f7a161d3-9e6a-44b0-8e00-f97fc241249a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:02.725358 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f7a161d3-9e6a-44b0-8e00-f97fc241249a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1523 microversion: 2.1 time: 0.187596 May 17 17:24:02.725936 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 176/332] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:02 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:02.872976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1775fc37-1aea-4347-8927-195029d7ddb8 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:02.873662 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1775fc37-1aea-4347-8927-195029d7ddb8 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:02.901593 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1775fc37-1aea-4347-8927-195029d7ddb8 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:02.903301 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1775fc37-1aea-4347-8927-195029d7ddb8 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:02.903301 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1775fc37-1aea-4347-8927-195029d7ddb8 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:02.903553 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1775fc37-1aea-4347-8927-195029d7ddb8 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:03.044982 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1775fc37-1aea-4347-8927-195029d7ddb8 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d565f5725984bf6908fd35b557f8736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e4a7b9a0a74c2788facfa3035fc8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:03.053273 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1775fc37-1aea-4347-8927-195029d7ddb8 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37" status: 200 len: 1258 microversion: 2.1 time: 0.186579 May 17 17:24:03.055638 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 177/333] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:02 2022] GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 => generated 1258 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:24:03.744162 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-548d2c71-476c-4aaf-8882-bf2e19accef2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:03.744754 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-548d2c71-476c-4aaf-8882-bf2e19accef2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:03.753229 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-548d2c71-476c-4aaf-8882-bf2e19accef2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:03.753743 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-548d2c71-476c-4aaf-8882-bf2e19accef2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:03.754954 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-548d2c71-476c-4aaf-8882-bf2e19accef2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:03.756088 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-548d2c71-476c-4aaf-8882-bf2e19accef2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:03.935674 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-548d2c71-476c-4aaf-8882-bf2e19accef2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:03.945940 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-548d2c71-476c-4aaf-8882-bf2e19accef2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1523 microversion: 2.1 time: 0.206747 May 17 17:24:03.947823 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 178/334] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:03 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:04.071166 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-61ddc3fb-702f-4073-ae9c-96c8a512c8c2 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:04.072087 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-61ddc3fb-702f-4073-ae9c-96c8a512c8c2 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:04.079451 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-61ddc3fb-702f-4073-ae9c-96c8a512c8c2 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:04.080203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-61ddc3fb-702f-4073-ae9c-96c8a512c8c2 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:04.081322 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-61ddc3fb-702f-4073-ae9c-96c8a512c8c2 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:04.081968 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-61ddc3fb-702f-4073-ae9c-96c8a512c8c2 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:04.270151 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-61ddc3fb-702f-4073-ae9c-96c8a512c8c2 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d565f5725984bf6908fd35b557f8736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e4a7b9a0a74c2788facfa3035fc8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:04.285546 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-61ddc3fb-702f-4073-ae9c-96c8a512c8c2 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37" status: 200 len: 1258 microversion: 2.1 time: 0.214048 May 17 17:24:04.285546 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 179/335] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:04 2022] GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 => generated 1258 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:24:04.968662 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f9391bf9-b3d7-46c0-a953-9ef2e81e1e71 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:04.972687 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f9391bf9-b3d7-46c0-a953-9ef2e81e1e71 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:04.981871 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f9391bf9-b3d7-46c0-a953-9ef2e81e1e71 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:04.982664 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f9391bf9-b3d7-46c0-a953-9ef2e81e1e71 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:04.984355 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f9391bf9-b3d7-46c0-a953-9ef2e81e1e71 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:04.985173 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f9391bf9-b3d7-46c0-a953-9ef2e81e1e71 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:05.159636 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f9391bf9-b3d7-46c0-a953-9ef2e81e1e71 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:05.170322 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f9391bf9-b3d7-46c0-a953-9ef2e81e1e71 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1523 microversion: 2.1 time: 0.204607 May 17 17:24:05.177139 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 180/336] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:04 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:24:05.300849 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f4d6b348-22a0-4048-9e82-fe207bfc5eae tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:05.301645 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f4d6b348-22a0-4048-9e82-fe207bfc5eae tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:05.308076 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f4d6b348-22a0-4048-9e82-fe207bfc5eae tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:05.308544 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f4d6b348-22a0-4048-9e82-fe207bfc5eae tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:05.309327 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f4d6b348-22a0-4048-9e82-fe207bfc5eae tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:05.309756 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f4d6b348-22a0-4048-9e82-fe207bfc5eae tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:05.485731 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f4d6b348-22a0-4048-9e82-fe207bfc5eae tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d565f5725984bf6908fd35b557f8736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e4a7b9a0a74c2788facfa3035fc8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:05.494018 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f4d6b348-22a0-4048-9e82-fe207bfc5eae tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37" status: 200 len: 1258 microversion: 2.1 time: 0.197238 May 17 17:24:05.494946 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 181/337] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:05 2022] GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 => generated 1258 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:06.184400 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-58d8b12c-5e79-4da8-8641-b1c3ad12340d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:06.186016 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-58d8b12c-5e79-4da8-8641-b1c3ad12340d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:06.198106 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-58d8b12c-5e79-4da8-8641-b1c3ad12340d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:06.201084 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-58d8b12c-5e79-4da8-8641-b1c3ad12340d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:06.204573 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-58d8b12c-5e79-4da8-8641-b1c3ad12340d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:06.205077 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-58d8b12c-5e79-4da8-8641-b1c3ad12340d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:06.406742 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-58d8b12c-5e79-4da8-8641-b1c3ad12340d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:06.428858 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-58d8b12c-5e79-4da8-8641-b1c3ad12340d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1523 microversion: 2.1 time: 0.247772 May 17 17:24:06.430460 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 182/338] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:06 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1523 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:24:06.510667 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c904ac3e-200b-456b-9928-5946c04eeeae tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:06.511698 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c904ac3e-200b-456b-9928-5946c04eeeae tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:06.518915 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c904ac3e-200b-456b-9928-5946c04eeeae tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:06.519988 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c904ac3e-200b-456b-9928-5946c04eeeae tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:06.521038 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c904ac3e-200b-456b-9928-5946c04eeeae tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:06.521666 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c904ac3e-200b-456b-9928-5946c04eeeae tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:06.730741 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c904ac3e-200b-456b-9928-5946c04eeeae tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d565f5725984bf6908fd35b557f8736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e4a7b9a0a74c2788facfa3035fc8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:06.738059 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c904ac3e-200b-456b-9928-5946c04eeeae tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37" status: 200 len: 1258 microversion: 2.1 time: 0.231491 May 17 17:24:06.743539 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 183/339] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:06 2022] GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 => generated 1258 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:24:07.288042 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d56f7adc-1b3a-4fa2-a696-28b788fba78a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:24:07.294282 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d56f7adc-1b3a-4fa2-a696-28b788fba78a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:07.294826 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d56f7adc-1b3a-4fa2-a696-28b788fba78a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:07.394879 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d56f7adc-1b3a-4fa2-a696-28b788fba78a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Going to try to stop instance {{(pid=117612) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 17 17:24:07.716178 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d56f7adc-1b3a-4fa2-a696-28b788fba78a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "POST /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f/action" status: 202 len: 0 microversion: 2.1 time: 0.431723 May 17 17:24:07.719840 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 184/340] 10.222.0.88 () {60 vars in 1277 bytes} [Tue May 17 17:24:07 2022] POST /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f/action => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 17 17:24:07.724392 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d6211734-9d76-4ae4-ab04-9b84903b0b9c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:07.725235 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d6211734-9d76-4ae4-ab04-9b84903b0b9c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:07.731720 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d6211734-9d76-4ae4-ab04-9b84903b0b9c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:07.732461 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d6211734-9d76-4ae4-ab04-9b84903b0b9c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:07.733517 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d6211734-9d76-4ae4-ab04-9b84903b0b9c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:07.734189 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d6211734-9d76-4ae4-ab04-9b84903b0b9c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:07.888742 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d6211734-9d76-4ae4-ab04-9b84903b0b9c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:07.904063 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d6211734-9d76-4ae4-ab04-9b84903b0b9c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1523 microversion: 2.1 time: 0.181023 May 17 17:24:07.904063 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 185/341] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:07 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:07.907313 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c3fe911a-6527-4457-b286-2663a5ac3926 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:07.908154 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c3fe911a-6527-4457-b286-2663a5ac3926 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:07.914824 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c3fe911a-6527-4457-b286-2663a5ac3926 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:07.915435 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c3fe911a-6527-4457-b286-2663a5ac3926 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:07.916578 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c3fe911a-6527-4457-b286-2663a5ac3926 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:07.917124 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c3fe911a-6527-4457-b286-2663a5ac3926 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:08.102721 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c3fe911a-6527-4457-b286-2663a5ac3926 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:08.113288 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c3fe911a-6527-4457-b286-2663a5ac3926 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1722 microversion: 2.1 time: 0.211085 May 17 17:24:08.114046 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 186/342] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:07 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:08.119652 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d33e4e87-ee82-4e94-8385-49ef6d2ec2b1 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:08.120725 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d33e4e87-ee82-4e94-8385-49ef6d2ec2b1 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:08.128719 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d33e4e87-ee82-4e94-8385-49ef6d2ec2b1 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:08.130675 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d33e4e87-ee82-4e94-8385-49ef6d2ec2b1 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:08.130675 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d33e4e87-ee82-4e94-8385-49ef6d2ec2b1 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:08.131161 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d33e4e87-ee82-4e94-8385-49ef6d2ec2b1 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:08.377069 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d33e4e87-ee82-4e94-8385-49ef6d2ec2b1 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d565f5725984bf6908fd35b557f8736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e4a7b9a0a74c2788facfa3035fc8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:08.388481 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d33e4e87-ee82-4e94-8385-49ef6d2ec2b1 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37" status: 200 len: 1258 microversion: 2.1 time: 0.270116 May 17 17:24:08.395563 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 187/343] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:08 2022] GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 => generated 1258 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:08.922588 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1578fca1-42ae-4f77-a15f-40d73a62c9eb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:08.935308 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1578fca1-42ae-4f77-a15f-40d73a62c9eb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:08.955687 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1578fca1-42ae-4f77-a15f-40d73a62c9eb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:08.962282 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1578fca1-42ae-4f77-a15f-40d73a62c9eb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:08.966827 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1578fca1-42ae-4f77-a15f-40d73a62c9eb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:08.972416 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1578fca1-42ae-4f77-a15f-40d73a62c9eb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:09.207624 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1578fca1-42ae-4f77-a15f-40d73a62c9eb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:09.226673 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1578fca1-42ae-4f77-a15f-40d73a62c9eb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1523 microversion: 2.1 time: 0.301132 May 17 17:24:09.227371 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 188/344] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:08 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1523 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:09.234072 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6c9b55a5-7e0a-4c33-b150-0bddafbc00be tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:09.234910 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6c9b55a5-7e0a-4c33-b150-0bddafbc00be tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:09.241930 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6c9b55a5-7e0a-4c33-b150-0bddafbc00be tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:09.245986 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6c9b55a5-7e0a-4c33-b150-0bddafbc00be tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:09.245986 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6c9b55a5-7e0a-4c33-b150-0bddafbc00be tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:09.245986 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6c9b55a5-7e0a-4c33-b150-0bddafbc00be tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:09.394058 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6c9b55a5-7e0a-4c33-b150-0bddafbc00be tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:09.410410 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6c9b55a5-7e0a-4c33-b150-0bddafbc00be tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1722 microversion: 2.1 time: 0.181623 May 17 17:24:09.411590 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 189/345] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:09 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:09.433433 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-025e85e8-242f-42f3-9438-5e9b43978a32 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:09.433433 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-025e85e8-242f-42f3-9438-5e9b43978a32 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:09.437333 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-025e85e8-242f-42f3-9438-5e9b43978a32 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:09.438180 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-025e85e8-242f-42f3-9438-5e9b43978a32 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:09.439282 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-025e85e8-242f-42f3-9438-5e9b43978a32 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:09.440162 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-025e85e8-242f-42f3-9438-5e9b43978a32 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:09.611494 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-025e85e8-242f-42f3-9438-5e9b43978a32 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d565f5725984bf6908fd35b557f8736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e4a7b9a0a74c2788facfa3035fc8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:09.637080 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-025e85e8-242f-42f3-9438-5e9b43978a32 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37" status: 200 len: 1258 microversion: 2.1 time: 0.213078 May 17 17:24:09.637972 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 190/346] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:09 2022] GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 => generated 1258 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:09.642785 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-fadbe729-c32f-47bc-b57e-46362ec9dc27 req-516b0127-6d48-4bcb-aa2e-0c221474aa20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf11f0d-a455-430a-b320-5163e1b98b37", "name": "network-vif-plugged", "status": "completed", "tag": "78dcbc08-7968-4aa1-95fa-f2034bb56aae"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:24:09.650932 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-fadbe729-c32f-47bc-b57e-46362ec9dc27 req-516b0127-6d48-4bcb-aa2e-0c221474aa20 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:09.651565 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-fadbe729-c32f-47bc-b57e-46362ec9dc27 req-516b0127-6d48-4bcb-aa2e-0c221474aa20 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:09.678135 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-fadbe729-c32f-47bc-b57e-46362ec9dc27 req-516b0127-6d48-4bcb-aa2e-0c221474aa20 service nova] Creating event network-vif-plugged:78dcbc08-7968-4aa1-95fa-f2034bb56aae for instance 9bf11f0d-a455-430a-b320-5163e1b98b37 on hv-cinder-84214 May 17 17:24:09.692943 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-fadbe729-c32f-47bc-b57e-46362ec9dc27 req-516b0127-6d48-4bcb-aa2e-0c221474aa20 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053578 May 17 17:24:09.693759 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 191/347] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:24:10.237139 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2639d18d-823a-446c-815e-c05d948c0661 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:10.240196 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2639d18d-823a-446c-815e-c05d948c0661 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:10.247982 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2639d18d-823a-446c-815e-c05d948c0661 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:10.248496 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2639d18d-823a-446c-815e-c05d948c0661 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:10.249390 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2639d18d-823a-446c-815e-c05d948c0661 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:10.249877 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2639d18d-823a-446c-815e-c05d948c0661 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:10.426261 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2639d18d-823a-446c-815e-c05d948c0661 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:10.434332 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2639d18d-823a-446c-815e-c05d948c0661 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1523 microversion: 2.1 time: 0.202463 May 17 17:24:10.434933 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 192/348] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:10 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:24:10.440252 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f3f283d2-0345-46a5-b943-de92b9b22697 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:10.440854 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f3f283d2-0345-46a5-b943-de92b9b22697 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:10.446630 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f3f283d2-0345-46a5-b943-de92b9b22697 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:10.446985 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f3f283d2-0345-46a5-b943-de92b9b22697 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:10.447950 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f3f283d2-0345-46a5-b943-de92b9b22697 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:10.448408 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f3f283d2-0345-46a5-b943-de92b9b22697 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:10.605997 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f3f283d2-0345-46a5-b943-de92b9b22697 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:10.614027 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f3f283d2-0345-46a5-b943-de92b9b22697 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1722 microversion: 2.1 time: 0.178062 May 17 17:24:10.615313 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 193/349] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:10 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:10.656671 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d3b4bdbf-2b7f-4e7c-b679-2a83eadc1166 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:10.657307 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d3b4bdbf-2b7f-4e7c-b679-2a83eadc1166 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:10.663773 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d3b4bdbf-2b7f-4e7c-b679-2a83eadc1166 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:10.666353 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d3b4bdbf-2b7f-4e7c-b679-2a83eadc1166 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:10.666353 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d3b4bdbf-2b7f-4e7c-b679-2a83eadc1166 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:10.666353 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d3b4bdbf-2b7f-4e7c-b679-2a83eadc1166 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:10.845524 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d3b4bdbf-2b7f-4e7c-b679-2a83eadc1166 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d565f5725984bf6908fd35b557f8736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e4a7b9a0a74c2788facfa3035fc8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:10.854057 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d3b4bdbf-2b7f-4e7c-b679-2a83eadc1166 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37" status: 200 len: 1258 microversion: 2.1 time: 0.202283 May 17 17:24:10.873052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 194/350] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:10 2022] GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 => generated 1258 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:24:11.453728 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1c5785d6-786d-4079-965f-bd6cafce7c14 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:11.454359 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1c5785d6-786d-4079-965f-bd6cafce7c14 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:11.460720 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1c5785d6-786d-4079-965f-bd6cafce7c14 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:11.461200 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1c5785d6-786d-4079-965f-bd6cafce7c14 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:11.461980 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1c5785d6-786d-4079-965f-bd6cafce7c14 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:11.462492 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1c5785d6-786d-4079-965f-bd6cafce7c14 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:11.614990 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1c5785d6-786d-4079-965f-bd6cafce7c14 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:11.623047 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1c5785d6-786d-4079-965f-bd6cafce7c14 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1523 microversion: 2.1 time: 0.173307 May 17 17:24:11.625004 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 195/351] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:11 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:24:11.635366 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e2b066c0-ac9f-41a1-829c-a034a77362d2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:11.636016 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e2b066c0-ac9f-41a1-829c-a034a77362d2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:11.643280 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e2b066c0-ac9f-41a1-829c-a034a77362d2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:11.643763 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e2b066c0-ac9f-41a1-829c-a034a77362d2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:11.644555 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e2b066c0-ac9f-41a1-829c-a034a77362d2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:11.644998 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e2b066c0-ac9f-41a1-829c-a034a77362d2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:11.794021 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e2b066c0-ac9f-41a1-829c-a034a77362d2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:11.802386 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e2b066c0-ac9f-41a1-829c-a034a77362d2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1722 microversion: 2.1 time: 0.172193 May 17 17:24:11.805162 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 196/352] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:11 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:11.879926 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-96fb114a-d798-4733-afa9-8b7f72060476 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:11.880812 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-96fb114a-d798-4733-afa9-8b7f72060476 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:11.887907 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-96fb114a-d798-4733-afa9-8b7f72060476 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:11.888535 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-96fb114a-d798-4733-afa9-8b7f72060476 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:11.889499 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-96fb114a-d798-4733-afa9-8b7f72060476 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:11.890097 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-96fb114a-d798-4733-afa9-8b7f72060476 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:12.044929 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-96fb114a-d798-4733-afa9-8b7f72060476 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d565f5725984bf6908fd35b557f8736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e4a7b9a0a74c2788facfa3035fc8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:12.053899 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-96fb114a-d798-4733-afa9-8b7f72060476 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37" status: 200 len: 1442 microversion: 2.1 time: 0.179503 May 17 17:24:12.054709 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 197/353] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:11 2022] GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 => generated 1442 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:12.074152 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c2ab63e4-b3c4-420a-97ec-09d863ab94e8 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:12.074717 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c2ab63e4-b3c4-420a-97ec-09d863ab94e8 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:12.085160 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c2ab63e4-b3c4-420a-97ec-09d863ab94e8 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:12.085614 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c2ab63e4-b3c4-420a-97ec-09d863ab94e8 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:12.086906 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c2ab63e4-b3c4-420a-97ec-09d863ab94e8 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:12.087286 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c2ab63e4-b3c4-420a-97ec-09d863ab94e8 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:12.319017 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c2ab63e4-b3c4-420a-97ec-09d863ab94e8 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d565f5725984bf6908fd35b557f8736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e4a7b9a0a74c2788facfa3035fc8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:12.326565 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c2ab63e4-b3c4-420a-97ec-09d863ab94e8 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37" status: 200 len: 1442 microversion: 2.1 time: 0.256621 May 17 17:24:12.327530 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 198/354] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:12 2022] GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 => generated 1442 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:12.645354 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-82c67479-8c01-4448-a75e-f5203714a6c3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:12.652756 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-82c67479-8c01-4448-a75e-f5203714a6c3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:12.677913 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-82c67479-8c01-4448-a75e-f5203714a6c3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:12.679501 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-82c67479-8c01-4448-a75e-f5203714a6c3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:12.684743 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-82c67479-8c01-4448-a75e-f5203714a6c3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:12.687715 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-82c67479-8c01-4448-a75e-f5203714a6c3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:12.940552 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-82c67479-8c01-4448-a75e-f5203714a6c3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:12.953368 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-82c67479-8c01-4448-a75e-f5203714a6c3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1523 microversion: 2.1 time: 0.314901 May 17 17:24:12.954565 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 199/355] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:12 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1523 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:12.976206 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f354212c-eb86-49ee-88a2-6df2efba723e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:12.977671 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f354212c-eb86-49ee-88a2-6df2efba723e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:12.993981 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f354212c-eb86-49ee-88a2-6df2efba723e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:12.998016 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f354212c-eb86-49ee-88a2-6df2efba723e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:12.999120 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f354212c-eb86-49ee-88a2-6df2efba723e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:12.999867 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f354212c-eb86-49ee-88a2-6df2efba723e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:13.006647 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-11b8d7d0-5eb2-4bfd-bab6-f309bdffcee7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "POST /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44/action" status: 202 len: 0 microversion: 2.20 time: 14.061419 May 17 17:24:13.013515 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 157/356] 10.222.0.88 () {62 vars in 1318 bytes} [Tue May 17 17:23:58 2022] POST /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44/action => generated 0 bytes in 14067 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 17:24:13.023107 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-110c6ed3-ffdc-4f93-a377-25cd52eeb521 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:13.023107 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-110c6ed3-ffdc-4f93-a377-25cd52eeb521 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:13.038677 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-110c6ed3-ffdc-4f93-a377-25cd52eeb521 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:13.039466 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-110c6ed3-ffdc-4f93-a377-25cd52eeb521 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:13.040621 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-110c6ed3-ffdc-4f93-a377-25cd52eeb521 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:13.041258 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-110c6ed3-ffdc-4f93-a377-25cd52eeb521 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:13.282785 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f354212c-eb86-49ee-88a2-6df2efba723e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:13.292588 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f354212c-eb86-49ee-88a2-6df2efba723e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1722 microversion: 2.1 time: 0.336719 May 17 17:24:13.293695 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 200/357] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:12 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1722 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:13.300105 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-110c6ed3-ffdc-4f93-a377-25cd52eeb521 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:13.309012 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-110c6ed3-ffdc-4f93-a377-25cd52eeb521 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:13.310794 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-110c6ed3-ffdc-4f93-a377-25cd52eeb521 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:13.317618 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-110c6ed3-ffdc-4f93-a377-25cd52eeb521 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1723 microversion: 2.20 time: 0.297582 May 17 17:24:13.317618 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 158/358] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:13 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:13.970991 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-352fa1d4-b4c2-4a0b-896c-7c3809c431e3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:13.972295 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-352fa1d4-b4c2-4a0b-896c-7c3809c431e3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:13.983810 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-352fa1d4-b4c2-4a0b-896c-7c3809c431e3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:13.989620 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-352fa1d4-b4c2-4a0b-896c-7c3809c431e3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:13.990574 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-352fa1d4-b4c2-4a0b-896c-7c3809c431e3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:13.992242 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-352fa1d4-b4c2-4a0b-896c-7c3809c431e3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:14.213970 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-352fa1d4-b4c2-4a0b-896c-7c3809c431e3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:14.224893 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-352fa1d4-b4c2-4a0b-896c-7c3809c431e3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1523 microversion: 2.1 time: 0.258509 May 17 17:24:14.226473 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 201/359] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:13 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1523 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:14.314678 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6f2a44d5-6f7c-4038-bca3-d41262a86acc tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:14.316021 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6f2a44d5-6f7c-4038-bca3-d41262a86acc tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:14.326501 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6f2a44d5-6f7c-4038-bca3-d41262a86acc tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:14.328064 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6f2a44d5-6f7c-4038-bca3-d41262a86acc tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:14.329112 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6f2a44d5-6f7c-4038-bca3-d41262a86acc tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:14.335020 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-bee44443-9d27-44e2-96b0-917d3079c5ac tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:14.335931 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-bee44443-9d27-44e2-96b0-917d3079c5ac tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:14.339340 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6f2a44d5-6f7c-4038-bca3-d41262a86acc tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:14.346076 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bee44443-9d27-44e2-96b0-917d3079c5ac tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:14.346925 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bee44443-9d27-44e2-96b0-917d3079c5ac tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:14.349502 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bee44443-9d27-44e2-96b0-917d3079c5ac tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:14.350534 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bee44443-9d27-44e2-96b0-917d3079c5ac tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:14.575444 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6f2a44d5-6f7c-4038-bca3-d41262a86acc tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:14.588742 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6f2a44d5-6f7c-4038-bca3-d41262a86acc tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1722 microversion: 2.1 time: 0.281193 May 17 17:24:14.589801 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 159/360] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:14 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1722 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:14.593809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-bee44443-9d27-44e2-96b0-917d3079c5ac tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:14.602534 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-bee44443-9d27-44e2-96b0-917d3079c5ac tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:14.606450 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-bee44443-9d27-44e2-96b0-917d3079c5ac tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:14.606450 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-bee44443-9d27-44e2-96b0-917d3079c5ac tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1723 microversion: 2.20 time: 0.274976 May 17 17:24:14.607404 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 202/361] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:14 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1723 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:24:15.243037 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8d156130-734d-49e1-b998-0538f7fb90ba tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:15.243578 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8d156130-734d-49e1-b998-0538f7fb90ba tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:15.252109 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8d156130-734d-49e1-b998-0538f7fb90ba tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:15.253540 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8d156130-734d-49e1-b998-0538f7fb90ba tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:15.254702 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8d156130-734d-49e1-b998-0538f7fb90ba tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:15.257330 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8d156130-734d-49e1-b998-0538f7fb90ba tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:15.484403 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8d156130-734d-49e1-b998-0538f7fb90ba tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:15.496259 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8d156130-734d-49e1-b998-0538f7fb90ba tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1523 microversion: 2.1 time: 0.257440 May 17 17:24:15.506389 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 160/362] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:15 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1523 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:15.606002 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a39b774d-79d0-45e5-891d-d017022ffe4e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:15.606781 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a39b774d-79d0-45e5-891d-d017022ffe4e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:15.625046 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-48780c5a-4573-4472-93be-56d4a2da219c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:15.625658 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-48780c5a-4573-4472-93be-56d4a2da219c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:15.632886 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a39b774d-79d0-45e5-891d-d017022ffe4e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:15.633334 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a39b774d-79d0-45e5-891d-d017022ffe4e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:15.634121 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a39b774d-79d0-45e5-891d-d017022ffe4e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:15.634558 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a39b774d-79d0-45e5-891d-d017022ffe4e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:15.638826 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-48780c5a-4573-4472-93be-56d4a2da219c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:15.639693 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-48780c5a-4573-4472-93be-56d4a2da219c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:15.641967 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-48780c5a-4573-4472-93be-56d4a2da219c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:15.642569 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-48780c5a-4573-4472-93be-56d4a2da219c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:15.965868 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-48780c5a-4573-4472-93be-56d4a2da219c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:15.975033 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-48780c5a-4573-4472-93be-56d4a2da219c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:15.981390 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-48780c5a-4573-4472-93be-56d4a2da219c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:15.982287 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a39b774d-79d0-45e5-891d-d017022ffe4e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:15.982985 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-48780c5a-4573-4472-93be-56d4a2da219c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1723 microversion: 2.20 time: 0.361848 May 17 17:24:15.984127 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 161/363] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:15 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1723 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:15.988710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-38dac60b-2fc2-40f7-9602-4e4903864c6a req-7e3af1d5-607d-48df-a0c0-988179ff795b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bf11f0d-a455-430a-b320-5163e1b98b37", "tag": "78dcbc08-7968-4aa1-95fa-f2034bb56aae"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:24:15.997627 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-38dac60b-2fc2-40f7-9602-4e4903864c6a req-7e3af1d5-607d-48df-a0c0-988179ff795b service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:15.998279 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-38dac60b-2fc2-40f7-9602-4e4903864c6a req-7e3af1d5-607d-48df-a0c0-988179ff795b service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:16.004683 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a39b774d-79d0-45e5-891d-d017022ffe4e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1722 microversion: 2.1 time: 0.401590 May 17 17:24:16.011099 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-38dac60b-2fc2-40f7-9602-4e4903864c6a req-7e3af1d5-607d-48df-a0c0-988179ff795b service nova] Creating event network-changed:78dcbc08-7968-4aa1-95fa-f2034bb56aae for instance 9bf11f0d-a455-430a-b320-5163e1b98b37 on hv-cinder-84214 May 17 17:24:16.016335 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-38dac60b-2fc2-40f7-9602-4e4903864c6a req-7e3af1d5-607d-48df-a0c0-988179ff795b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030857 May 17 17:24:16.020459 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 203/364] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:15 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1722 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:16.020985 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 162/365] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:24:16.513560 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-39b5bf0e-da54-4994-8cc6-07d07edcc26c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:16.514507 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-39b5bf0e-da54-4994-8cc6-07d07edcc26c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:16.532726 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-39b5bf0e-da54-4994-8cc6-07d07edcc26c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:16.535131 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-39b5bf0e-da54-4994-8cc6-07d07edcc26c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:16.536207 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-39b5bf0e-da54-4994-8cc6-07d07edcc26c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:16.542462 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-39b5bf0e-da54-4994-8cc6-07d07edcc26c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:16.907154 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-39b5bf0e-da54-4994-8cc6-07d07edcc26c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:16.916353 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-39b5bf0e-da54-4994-8cc6-07d07edcc26c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1503 microversion: 2.1 time: 0.406461 May 17 17:24:16.934818 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 204/366] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:16 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1503 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:16.943916 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a587ad21-9476-4ee4-9af6-8d667fd63666 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f255f8f-1862-4821-ba89-4e6e1c4d2ce6"}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:24:16.946105 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a587ad21-9476-4ee4-9af6-8d667fd63666 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:16.953840 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a587ad21-9476-4ee4-9af6-8d667fd63666 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:16.960948 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a587ad21-9476-4ee4-9af6-8d667fd63666 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:16.962281 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a587ad21-9476-4ee4-9af6-8d667fd63666 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:16.963080 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a587ad21-9476-4ee4-9af6-8d667fd63666 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:16.991177 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-a587ad21-9476-4ee4-9af6-8d667fd63666 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] HTTP exception thrown: Cannot 'attach_volume' instance 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d while it is in vm_state rescued May 17 17:24:16.992894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a587ad21-9476-4ee4-9af6-8d667fd63666 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Request method failure captured: May 17 17:24:16.992894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: POST /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d/os-volume_attachments HTTP/1.1 May 17 17:24:16.992894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:24:16.992894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:24:16.992894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:24:16.992894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 74 May 17 17:24:16.992894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:24:16.992894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:24:16.992894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:24:16.992894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:24:16.992894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9nCRi7Ba9wQiT8Z77JafySk8CdhUt_ec4kFMIRq6DJ0yX_by762ZReR6jSTE7KXCyjCidygrSXAWsVX8isiTVL587-vJGZ3qsfPn7-65abLAEk6QPzTaTbYhBW-eVDouiob09eQRF2fFsF4z6eAkOVL065D-HYqt2yjlfRzYvbvUJA May 17 17:24:16.992894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:24:16.992894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:24:16.992894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:24:16.992894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:24:16.992894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:24:16.992894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:24:16.992894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: d2b0be03d2fd4baf84d7d0b462392cba May 17 17:24:16.992894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-82631249 May 17 17:24:16.992894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:24:16.992894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:24:16.995544 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d2b0be03d2fd4baf84d7d0b462392cba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/d2b0be03d2fd4baf84d7d0b462392cba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d2b0be03d2fd4baf84d7d0b462392cba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_d2b0be03d2fd4baf84d7d0b462392cba", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:24:16.995544 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-ServerRescueNegativeTestJSON-82631249 May 17 17:24:16.995544 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: d2b0be03d2fd4baf84d7d0b462392cba May 17 17:24:16.995544 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-82631249 May 17 17:24:16.995544 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-ServerRescueNegativeTestJSON-82631249-project May 17 17:24:16.995544 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:24:16.995544 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:24:16.995544 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 8ebdfee8d3d64c2696e9c5695cebdba3 May 17 17:24:16.995544 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-ServerRescueNegativeTestJSON-82631249-project May 17 17:24:16.995544 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: May 17 17:24:16.995544 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {"volumeAttachment": {"volumeId": "5f255f8f-1862-4821-ba89-4e6e1c4d2ce6"}} May 17 17:24:16.995544 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:24:16.996598 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Cannot 'attach_volume' instance 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d while it is in vm_state rescued May 17 17:24:16.996598 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'server_id': '2ea4b9c8-340b-4cd6-abdd-419071fc0b0d', 'body': {'volumeAttachment': {'volumeId': '5f255f8f-1862-4821-ba89-4e6e1c4d2ce6'}}} May 17 17:24:16.996598 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:24:16.996598 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:24:16.996598 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 17 17:24:16.996598 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 17 17:24:16.996598 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 17 17:24:16.996598 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 17 17:24:16.996598 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 17 17:24:16.996598 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 17 17:24:16.996598 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d in vm_state rescued. Cannot attach_volume while the instance is in this state. May 17 17:24:16.996598 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:24:16.996598 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:24:16.996598 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:24:16.996598 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:24:16.996598 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:24:16.996598 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:24:16.996598 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:24:16.996598 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:24:16.997864 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:24:16.997864 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:24:16.997864 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 17:24:16.997864 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 17:24:16.997864 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 17:24:16.997864 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 17:24:16.997864 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 17:24:16.997864 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 17:24:16.997864 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 17 17:24:16.997864 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 17 17:24:16.997864 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 17 17:24:16.997864 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 17 17:24:16.997864 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d while it is in vm_state rescued May 17 17:24:16.997864 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:24:16.997864 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:24:16.997864 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:24:16.997864 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:24:16.997864 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:24:16.997864 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:24:17.000840 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:24:17.000840 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:24:17.000840 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d while it is in vm_state rescued May 17 17:24:17.000840 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:24:17.000840 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a587ad21-9476-4ee4-9af6-8d667fd63666 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Returning 409 to user: Cannot 'attach_volume' instance 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d while it is in vm_state rescued {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:24:17.002881 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a587ad21-9476-4ee4-9af6-8d667fd63666 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "POST /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.066768 May 17 17:24:17.004500 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 163/367] 10.222.0.88 () {60 vars in 1322 bytes} [Tue May 17 17:24:16 2022] POST /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d/os-volume_attachments => generated 152 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 17 17:24:17.031564 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5cd76f87-b000-447e-b026-55d62d9ad6b3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:24:17.031564 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-5cd76f87-b000-447e-b026-55d62d9ad6b3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:17.035207 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5cd76f87-b000-447e-b026-55d62d9ad6b3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:17.035207 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5cd76f87-b000-447e-b026-55d62d9ad6b3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:17.035354 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5cd76f87-b000-447e-b026-55d62d9ad6b3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:17.035779 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5cd76f87-b000-447e-b026-55d62d9ad6b3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:17.037202 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0c5ea3db-5097-4865-8c29-a29517291e3d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:17.038054 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0c5ea3db-5097-4865-8c29-a29517291e3d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:17.044734 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0c5ea3db-5097-4865-8c29-a29517291e3d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:17.045604 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0c5ea3db-5097-4865-8c29-a29517291e3d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:17.047146 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0c5ea3db-5097-4865-8c29-a29517291e3d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:17.047824 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0c5ea3db-5097-4865-8c29-a29517291e3d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:17.221076 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0c5ea3db-5097-4865-8c29-a29517291e3d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:17.229203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0c5ea3db-5097-4865-8c29-a29517291e3d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:17.230738 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0c5ea3db-5097-4865-8c29-a29517291e3d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:17.231903 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0c5ea3db-5097-4865-8c29-a29517291e3d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1723 microversion: 2.20 time: 0.210946 May 17 17:24:17.232465 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 205/368] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:17 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:17.237521 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-9db2d15c-5277-4fc6-9071-4984bf280bee tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:17.238177 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-9db2d15c-5277-4fc6-9071-4984bf280bee tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:17.243831 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9db2d15c-5277-4fc6-9071-4984bf280bee tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:17.244299 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9db2d15c-5277-4fc6-9071-4984bf280bee tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:17.245128 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9db2d15c-5277-4fc6-9071-4984bf280bee tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:17.245554 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9db2d15c-5277-4fc6-9071-4984bf280bee tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:17.376976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-9db2d15c-5277-4fc6-9071-4984bf280bee tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:17.384697 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-9db2d15c-5277-4fc6-9071-4984bf280bee tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1722 microversion: 2.1 time: 0.151226 May 17 17:24:17.387425 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 206/369] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:17 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:17.519933 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5cd76f87-b000-447e-b026-55d62d9ad6b3 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "POST /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d/action" status: 202 len: 0 microversion: 2.1 time: 0.498527 May 17 17:24:17.523813 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 164/370] 10.222.0.88 () {60 vars in 1277 bytes} [Tue May 17 17:24:17 2022] POST /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:24:17.529093 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-651c750c-0d94-471e-97eb-384329b1af97 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:17.529831 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-651c750c-0d94-471e-97eb-384329b1af97 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:17.538670 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-651c750c-0d94-471e-97eb-384329b1af97 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:17.539127 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-651c750c-0d94-471e-97eb-384329b1af97 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:17.541391 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-651c750c-0d94-471e-97eb-384329b1af97 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:17.541391 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-651c750c-0d94-471e-97eb-384329b1af97 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:17.760993 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-651c750c-0d94-471e-97eb-384329b1af97 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:17.769775 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-651c750c-0d94-471e-97eb-384329b1af97 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1511 microversion: 2.1 time: 0.244533 May 17 17:24:17.772774 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 207/371] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:17 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1511 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:18.251495 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e3c082bb-d018-4b28-aedb-41c8013358cd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:18.253323 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e3c082bb-d018-4b28-aedb-41c8013358cd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:18.259627 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e3c082bb-d018-4b28-aedb-41c8013358cd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:18.260297 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e3c082bb-d018-4b28-aedb-41c8013358cd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:18.261242 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e3c082bb-d018-4b28-aedb-41c8013358cd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:18.261838 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e3c082bb-d018-4b28-aedb-41c8013358cd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:18.401952 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8101ab2b-89ee-45d8-ae78-9ed5771352f4 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:18.403388 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8101ab2b-89ee-45d8-ae78-9ed5771352f4 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:18.412585 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8101ab2b-89ee-45d8-ae78-9ed5771352f4 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:18.413029 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8101ab2b-89ee-45d8-ae78-9ed5771352f4 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:18.414128 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8101ab2b-89ee-45d8-ae78-9ed5771352f4 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:18.414656 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8101ab2b-89ee-45d8-ae78-9ed5771352f4 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:18.441407 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e3c082bb-d018-4b28-aedb-41c8013358cd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:18.450381 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e3c082bb-d018-4b28-aedb-41c8013358cd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:18.454335 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e3c082bb-d018-4b28-aedb-41c8013358cd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:18.454335 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e3c082bb-d018-4b28-aedb-41c8013358cd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1723 microversion: 2.20 time: 0.206568 May 17 17:24:18.454335 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 165/372] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:18 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:18.553561 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8101ab2b-89ee-45d8-ae78-9ed5771352f4 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:18.561464 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8101ab2b-89ee-45d8-ae78-9ed5771352f4 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1722 microversion: 2.1 time: 0.163437 May 17 17:24:18.565946 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 208/373] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:18 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:24:18.789522 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f330ff82-4e1d-4633-bdb1-505f5ea24cb0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:18.790922 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f330ff82-4e1d-4633-bdb1-505f5ea24cb0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:18.803016 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f330ff82-4e1d-4633-bdb1-505f5ea24cb0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:18.803423 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f330ff82-4e1d-4633-bdb1-505f5ea24cb0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:18.804861 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f330ff82-4e1d-4633-bdb1-505f5ea24cb0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:18.806803 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f330ff82-4e1d-4633-bdb1-505f5ea24cb0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:19.007861 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f330ff82-4e1d-4633-bdb1-505f5ea24cb0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:19.016248 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f330ff82-4e1d-4633-bdb1-505f5ea24cb0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1511 microversion: 2.1 time: 0.231092 May 17 17:24:19.017376 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 166/374] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:18 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1511 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:24:19.473339 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7d0b7a50-e4ab-4bb2-827d-0a7a2af65793 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:19.475090 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-7d0b7a50-e4ab-4bb2-827d-0a7a2af65793 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:19.485886 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7d0b7a50-e4ab-4bb2-827d-0a7a2af65793 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:19.486700 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7d0b7a50-e4ab-4bb2-827d-0a7a2af65793 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:19.487835 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7d0b7a50-e4ab-4bb2-827d-0a7a2af65793 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:19.488451 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7d0b7a50-e4ab-4bb2-827d-0a7a2af65793 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:19.578529 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-cf0b8dd0-ea51-4426-aca2-c0dc1b186d3f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:19.579058 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-cf0b8dd0-ea51-4426-aca2-c0dc1b186d3f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:19.597940 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cf0b8dd0-ea51-4426-aca2-c0dc1b186d3f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:19.598598 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cf0b8dd0-ea51-4426-aca2-c0dc1b186d3f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:19.599602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cf0b8dd0-ea51-4426-aca2-c0dc1b186d3f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:19.600197 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cf0b8dd0-ea51-4426-aca2-c0dc1b186d3f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:19.687720 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7d0b7a50-e4ab-4bb2-827d-0a7a2af65793 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:19.695754 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7d0b7a50-e4ab-4bb2-827d-0a7a2af65793 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:19.700841 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7d0b7a50-e4ab-4bb2-827d-0a7a2af65793 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:19.702005 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7d0b7a50-e4ab-4bb2-827d-0a7a2af65793 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1723 microversion: 2.20 time: 0.233984 May 17 17:24:19.715606 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 209/375] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:19 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:19.789600 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-cf0b8dd0-ea51-4426-aca2-c0dc1b186d3f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:19.809397 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-cf0b8dd0-ea51-4426-aca2-c0dc1b186d3f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1722 microversion: 2.1 time: 0.235011 May 17 17:24:19.836339 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 167/376] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:19 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:20.033619 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0c0533c0-182b-44c4-8288-125104af681d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:20.034373 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0c0533c0-182b-44c4-8288-125104af681d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:20.040839 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0c0533c0-182b-44c4-8288-125104af681d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:20.041562 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0c0533c0-182b-44c4-8288-125104af681d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:20.042435 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0c0533c0-182b-44c4-8288-125104af681d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:20.042935 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0c0533c0-182b-44c4-8288-125104af681d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:20.198841 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0c0533c0-182b-44c4-8288-125104af681d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:20.206524 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0c0533c0-182b-44c4-8288-125104af681d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1511 microversion: 2.1 time: 0.177316 May 17 17:24:20.207094 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 210/377] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:20 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:20.722859 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f9eeb3ad-df30-4eca-b963-c2d47a3ce0a0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:20.723719 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f9eeb3ad-df30-4eca-b963-c2d47a3ce0a0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:20.730251 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f9eeb3ad-df30-4eca-b963-c2d47a3ce0a0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:20.730824 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f9eeb3ad-df30-4eca-b963-c2d47a3ce0a0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:20.731731 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f9eeb3ad-df30-4eca-b963-c2d47a3ce0a0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:20.732474 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f9eeb3ad-df30-4eca-b963-c2d47a3ce0a0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:20.833776 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0e5789c4-bd76-4453-bd01-605c2f9a6504 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:20.835031 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0e5789c4-bd76-4453-bd01-605c2f9a6504 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:20.845202 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0e5789c4-bd76-4453-bd01-605c2f9a6504 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:20.845708 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0e5789c4-bd76-4453-bd01-605c2f9a6504 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:20.846499 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0e5789c4-bd76-4453-bd01-605c2f9a6504 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:20.846865 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0e5789c4-bd76-4453-bd01-605c2f9a6504 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:21.014621 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f9eeb3ad-df30-4eca-b963-c2d47a3ce0a0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:21.014621 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f9eeb3ad-df30-4eca-b963-c2d47a3ce0a0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:21.019352 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f9eeb3ad-df30-4eca-b963-c2d47a3ce0a0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:21.020625 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f9eeb3ad-df30-4eca-b963-c2d47a3ce0a0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1723 microversion: 2.20 time: 0.302349 May 17 17:24:21.021207 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 168/378] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:20 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1723 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:21.212257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0e5789c4-bd76-4453-bd01-605c2f9a6504 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:21.239898 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0e5789c4-bd76-4453-bd01-605c2f9a6504 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1722 microversion: 2.1 time: 0.400546 May 17 17:24:21.239898 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 211/379] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:20 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1722 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:21.248160 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c6a9c8cb-1466-401a-b21e-e20a33ed2170 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:21.249297 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c6a9c8cb-1466-401a-b21e-e20a33ed2170 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:21.260265 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c6a9c8cb-1466-401a-b21e-e20a33ed2170 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:21.260785 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c6a9c8cb-1466-401a-b21e-e20a33ed2170 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:21.264495 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c6a9c8cb-1466-401a-b21e-e20a33ed2170 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:21.264495 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c6a9c8cb-1466-401a-b21e-e20a33ed2170 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:21.420134 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c6a9c8cb-1466-401a-b21e-e20a33ed2170 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:21.420134 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c6a9c8cb-1466-401a-b21e-e20a33ed2170 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1511 microversion: 2.1 time: 0.176107 May 17 17:24:21.420445 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 169/380] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:21 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1511 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:22.057394 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c491b1a4-8387-4652-a8bf-3de70acfff2b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:22.057982 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c491b1a4-8387-4652-a8bf-3de70acfff2b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:22.064306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c491b1a4-8387-4652-a8bf-3de70acfff2b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:22.064959 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c491b1a4-8387-4652-a8bf-3de70acfff2b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:22.065945 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c491b1a4-8387-4652-a8bf-3de70acfff2b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:22.066375 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c491b1a4-8387-4652-a8bf-3de70acfff2b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:22.246032 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-44be381b-a21b-4ff9-bcbf-25a1837e2e40 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:22.246712 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-44be381b-a21b-4ff9-bcbf-25a1837e2e40 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:22.260836 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-44be381b-a21b-4ff9-bcbf-25a1837e2e40 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:22.265271 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-44be381b-a21b-4ff9-bcbf-25a1837e2e40 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:22.265271 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-44be381b-a21b-4ff9-bcbf-25a1837e2e40 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:22.265271 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-44be381b-a21b-4ff9-bcbf-25a1837e2e40 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:22.478127 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c491b1a4-8387-4652-a8bf-3de70acfff2b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:22.493082 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c491b1a4-8387-4652-a8bf-3de70acfff2b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:22.494863 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c491b1a4-8387-4652-a8bf-3de70acfff2b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:22.496273 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c491b1a4-8387-4652-a8bf-3de70acfff2b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1723 microversion: 2.20 time: 0.442586 May 17 17:24:22.496833 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 212/381] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:22 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1723 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:22.502088 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c6a5ea3c-1b39-4158-8672-6113ecdea34a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:22.502687 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c6a5ea3c-1b39-4158-8672-6113ecdea34a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:22.512690 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c6a5ea3c-1b39-4158-8672-6113ecdea34a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:22.512690 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c6a5ea3c-1b39-4158-8672-6113ecdea34a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:22.512690 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c6a5ea3c-1b39-4158-8672-6113ecdea34a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:22.512690 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c6a5ea3c-1b39-4158-8672-6113ecdea34a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:22.598154 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-44be381b-a21b-4ff9-bcbf-25a1837e2e40 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:22.609865 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-44be381b-a21b-4ff9-bcbf-25a1837e2e40 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1722 microversion: 2.1 time: 0.367788 May 17 17:24:22.610497 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 170/382] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:22 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1722 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:24:22.670644 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c6a5ea3c-1b39-4158-8672-6113ecdea34a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:22.679368 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c6a5ea3c-1b39-4158-8672-6113ecdea34a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1517 microversion: 2.1 time: 0.181171 May 17 17:24:22.683554 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 213/383] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:22 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1517 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:23.519834 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f8b169e3-5036-477c-90ee-e1f6c6ab8171 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:23.519834 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f8b169e3-5036-477c-90ee-e1f6c6ab8171 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:23.523089 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8b169e3-5036-477c-90ee-e1f6c6ab8171 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:23.523554 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8b169e3-5036-477c-90ee-e1f6c6ab8171 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:23.524357 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8b169e3-5036-477c-90ee-e1f6c6ab8171 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:23.524786 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8b169e3-5036-477c-90ee-e1f6c6ab8171 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:23.626762 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1d0fd421-7ddd-4b7d-bc6c-4ece5b99fae1 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:23.627373 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1d0fd421-7ddd-4b7d-bc6c-4ece5b99fae1 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:23.633280 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1d0fd421-7ddd-4b7d-bc6c-4ece5b99fae1 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:23.633731 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1d0fd421-7ddd-4b7d-bc6c-4ece5b99fae1 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:23.634548 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1d0fd421-7ddd-4b7d-bc6c-4ece5b99fae1 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:23.634945 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1d0fd421-7ddd-4b7d-bc6c-4ece5b99fae1 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:23.658968 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f8b169e3-5036-477c-90ee-e1f6c6ab8171 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:23.667734 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f8b169e3-5036-477c-90ee-e1f6c6ab8171 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:23.669445 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f8b169e3-5036-477c-90ee-e1f6c6ab8171 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:23.670627 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f8b169e3-5036-477c-90ee-e1f6c6ab8171 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1723 microversion: 2.20 time: 0.160470 May 17 17:24:23.671205 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 171/384] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:23 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:23.775892 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1d0fd421-7ddd-4b7d-bc6c-4ece5b99fae1 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:23.783892 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1d0fd421-7ddd-4b7d-bc6c-4ece5b99fae1 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1722 microversion: 2.1 time: 0.161577 May 17 17:24:23.784457 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 214/385] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:23 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:24:24.303744 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b4447f4b-6d1a-47aa-a0af-fe2daaa08efc tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Action: 'create', calling method: .version_select at 0x7f73d0282d30>, body: {"keypair": {"name": "tempest-keypair-591879903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKt0Ab3NIX0P+nDrVNdQF5mBGgF+IDAEq3PlT26smgh8++71ZHvlfC4gcZl7BAggrSr6neoWZD6FrNZk2lWwN8POowp8jLO+XHbPPzADV0pl3sXBkHRXpS4qTVw6gmU6LQ=="}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:24:24.327940 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-b4447f4b-6d1a-47aa-a0af-fe2daaa08efc tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Getting quotas for project d2b0be03d2fd4baf84d7d0b462392cba. Resources: {'key_pairs'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:24:24.331972 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-b4447f4b-6d1a-47aa-a0af-fe2daaa08efc tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Getting quotas for user 8ebdfee8d3d64c2696e9c5695cebdba3 and project d2b0be03d2fd4baf84d7d0b462392cba. Resources: {'key_pairs'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:24:24.511267 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b4447f4b-6d1a-47aa-a0af-fe2daaa08efc tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.211529 May 17 17:24:24.511962 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 172/386] 10.222.0.88 () {60 vars in 1158 bytes} [Tue May 17 17:24:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:24:24.689518 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b60920a7-8adb-44ce-a38d-331520103839 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:24.690673 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b60920a7-8adb-44ce-a38d-331520103839 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:24.699142 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b60920a7-8adb-44ce-a38d-331520103839 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:24.700246 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b60920a7-8adb-44ce-a38d-331520103839 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:24.701030 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b60920a7-8adb-44ce-a38d-331520103839 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:24.702696 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b60920a7-8adb-44ce-a38d-331520103839 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:24.801865 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-42edb67b-3f9b-4af7-ab96-ff1c689b1f3f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:24.802758 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-42edb67b-3f9b-4af7-ab96-ff1c689b1f3f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:24.809930 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-42edb67b-3f9b-4af7-ab96-ff1c689b1f3f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:24.811104 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-42edb67b-3f9b-4af7-ab96-ff1c689b1f3f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:24.812515 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-42edb67b-3f9b-4af7-ab96-ff1c689b1f3f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:24.813171 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-42edb67b-3f9b-4af7-ab96-ff1c689b1f3f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:24.838348 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b60920a7-8adb-44ce-a38d-331520103839 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:24.848154 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b60920a7-8adb-44ce-a38d-331520103839 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:24.849736 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b60920a7-8adb-44ce-a38d-331520103839 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:24.851188 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b60920a7-8adb-44ce-a38d-331520103839 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1723 microversion: 2.20 time: 0.166006 May 17 17:24:24.860964 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 215/387] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:24 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:24.962085 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-42edb67b-3f9b-4af7-ab96-ff1c689b1f3f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:24.970351 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-42edb67b-3f9b-4af7-ab96-ff1c689b1f3f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1722 microversion: 2.1 time: 0.172987 May 17 17:24:24.971433 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 173/388] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:24 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:24:25.870054 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-9f43782a-f7c4-4a89-acc5-a626126bbc81 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:25.871275 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-9f43782a-f7c4-4a89-acc5-a626126bbc81 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:25.877859 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9f43782a-f7c4-4a89-acc5-a626126bbc81 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:25.878308 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9f43782a-f7c4-4a89-acc5-a626126bbc81 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:25.879278 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9f43782a-f7c4-4a89-acc5-a626126bbc81 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:25.879900 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9f43782a-f7c4-4a89-acc5-a626126bbc81 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:25.999226 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-0dba7ba9-0798-4683-b7c4-b5ef09e37cc1 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:26.000663 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-0dba7ba9-0798-4683-b7c4-b5ef09e37cc1 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:26.008331 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0dba7ba9-0798-4683-b7c4-b5ef09e37cc1 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:26.009264 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0dba7ba9-0798-4683-b7c4-b5ef09e37cc1 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:26.018605 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-9f43782a-f7c4-4a89-acc5-a626126bbc81 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:26.018804 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0dba7ba9-0798-4683-b7c4-b5ef09e37cc1 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:26.018804 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0dba7ba9-0798-4683-b7c4-b5ef09e37cc1 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:26.021894 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-9f43782a-f7c4-4a89-acc5-a626126bbc81 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:26.023472 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-9f43782a-f7c4-4a89-acc5-a626126bbc81 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:26.024772 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-9f43782a-f7c4-4a89-acc5-a626126bbc81 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1723 microversion: 2.20 time: 0.158562 May 17 17:24:26.025432 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 216/389] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:25 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:26.159697 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-0dba7ba9-0798-4683-b7c4-b5ef09e37cc1 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:26.167945 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-0dba7ba9-0798-4683-b7c4-b5ef09e37cc1 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1722 microversion: 2.1 time: 0.174806 May 17 17:24:26.168519 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 174/390] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:25 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:24:26.948060 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2b6e16f3-80bd-45fc-ae77-06fafe2dfca7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1981466747", "imageRef": "800c492c-ff69-4735-b2c9-a2dcaa20aa8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3d831360-285e-4277-a650-d6bcbf399d51"}], "security_groups": [{"name": "tempest-securitygroup--470300210"}], "key_name": "tempest-keypair-591879903", "user_data": "}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:24:27.044334 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-73b7bfba-3fb2-4cec-9a90-34929c42c6c6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:27.045099 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-73b7bfba-3fb2-4cec-9a90-34929c42c6c6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:27.051878 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-73b7bfba-3fb2-4cec-9a90-34929c42c6c6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:27.052558 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-73b7bfba-3fb2-4cec-9a90-34929c42c6c6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:27.053334 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-73b7bfba-3fb2-4cec-9a90-34929c42c6c6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:27.053758 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-73b7bfba-3fb2-4cec-9a90-34929c42c6c6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:27.110809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.network.neutron [None req-2b6e16f3-80bd-45fc-ae77-06fafe2dfca7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] validate_networks() for [('3d831360-285e-4277-a650-d6bcbf399d51', None, None, None, None, None)] {{(pid=117612) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:24:27.289151 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-73b7bfba-3fb2-4cec-9a90-34929c42c6c6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:27.298802 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-73b7bfba-3fb2-4cec-9a90-34929c42c6c6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:27.301426 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-73b7bfba-3fb2-4cec-9a90-34929c42c6c6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:27.302024 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-73b7bfba-3fb2-4cec-9a90-34929c42c6c6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1723 microversion: 2.20 time: 0.261857 May 17 17:24:27.306389 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 175/391] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:27 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:27.310835 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-92734f87-0f96-4b7c-b362-d9cc52901fed tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:27.311986 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-92734f87-0f96-4b7c-b362-d9cc52901fed tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:27.317917 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-92734f87-0f96-4b7c-b362-d9cc52901fed tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:27.318438 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-92734f87-0f96-4b7c-b362-d9cc52901fed tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:27.319408 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-92734f87-0f96-4b7c-b362-d9cc52901fed tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:27.323559 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-92734f87-0f96-4b7c-b362-d9cc52901fed tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:27.582014 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-92734f87-0f96-4b7c-b362-d9cc52901fed tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:27.596264 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-92734f87-0f96-4b7c-b362-d9cc52901fed tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1722 microversion: 2.1 time: 0.286510 May 17 17:24:27.598186 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 176/392] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:27 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:27.732517 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-2b6e16f3-80bd-45fc-ae77-06fafe2dfca7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Flavor limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:24:27.732934 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-2b6e16f3-80bd-45fc-ae77-06fafe2dfca7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Image limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:24:27.734072 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-2b6e16f3-80bd-45fc-ae77-06fafe2dfca7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Flavor pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:24:27.734477 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-2b6e16f3-80bd-45fc-ae77-06fafe2dfca7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Image pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:24:27.734879 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-2b6e16f3-80bd-45fc-ae77-06fafe2dfca7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:24:27.743264 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2b6e16f3-80bd-45fc-ae77-06fafe2dfca7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:27.743755 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2b6e16f3-80bd-45fc-ae77-06fafe2dfca7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:27.744535 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2b6e16f3-80bd-45fc-ae77-06fafe2dfca7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:27.744963 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2b6e16f3-80bd-45fc-ae77-06fafe2dfca7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:27.760642 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-2b6e16f3-80bd-45fc-ae77-06fafe2dfca7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Getting quotas for project d2b0be03d2fd4baf84d7d0b462392cba. Resources: {'cores', 'ram', 'instances'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:24:27.764490 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-2b6e16f3-80bd-45fc-ae77-06fafe2dfca7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Getting quotas for user 8ebdfee8d3d64c2696e9c5695cebdba3 and project d2b0be03d2fd4baf84d7d0b462392cba. Resources: {'cores', 'ram', 'instances'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:24:27.774935 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2b6e16f3-80bd-45fc-ae77-06fafe2dfca7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Going to run 1 instances... {{(pid=117612) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:24:27.777269 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2b6e16f3-80bd-45fc-ae77-06fafe2dfca7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='800c492c-ff69-4735-b2c9-a2dcaa20aa8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:24:27.891999 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2b6e16f3-80bd-45fc-ae77-06fafe2dfca7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.948465 May 17 17:24:27.893600 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 217/393] 10.222.0.88 () {60 vars in 1146 bytes} [Tue May 17 17:24:26 2022] POST /compute/v2.1/servers => generated 408 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:24:27.903599 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-081151c8-13b6-4f89-b560-0e1a39e2f680 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:27.904243 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-081151c8-13b6-4f89-b560-0e1a39e2f680 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:27.974019 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-081151c8-13b6-4f89-b560-0e1a39e2f680 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:27.981493 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-081151c8-13b6-4f89-b560-0e1a39e2f680 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1245 microversion: 2.1 time: 0.081695 May 17 17:24:27.984125 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 177/394] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:27 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:28.323841 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2df7c108-d5ff-440b-8a9a-775664be4e27 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:28.325255 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2df7c108-d5ff-440b-8a9a-775664be4e27 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:28.334779 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2df7c108-d5ff-440b-8a9a-775664be4e27 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:28.335442 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2df7c108-d5ff-440b-8a9a-775664be4e27 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:28.336691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2df7c108-d5ff-440b-8a9a-775664be4e27 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:28.343394 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2df7c108-d5ff-440b-8a9a-775664be4e27 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:28.470415 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2df7c108-d5ff-440b-8a9a-775664be4e27 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:28.478131 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2df7c108-d5ff-440b-8a9a-775664be4e27 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:28.479652 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2df7c108-d5ff-440b-8a9a-775664be4e27 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:28.480794 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2df7c108-d5ff-440b-8a9a-775664be4e27 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1723 microversion: 2.20 time: 0.162644 May 17 17:24:28.481335 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 218/395] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:28 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:24:28.614095 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6764bcba-23d0-42f9-ba07-45b366cbcf65 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:28.614737 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6764bcba-23d0-42f9-ba07-45b366cbcf65 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:28.627242 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6764bcba-23d0-42f9-ba07-45b366cbcf65 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:28.627732 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6764bcba-23d0-42f9-ba07-45b366cbcf65 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:28.628684 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6764bcba-23d0-42f9-ba07-45b366cbcf65 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:28.629210 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6764bcba-23d0-42f9-ba07-45b366cbcf65 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:28.764272 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6764bcba-23d0-42f9-ba07-45b366cbcf65 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:28.774529 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6764bcba-23d0-42f9-ba07-45b366cbcf65 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1699 microversion: 2.1 time: 0.164675 May 17 17:24:28.776424 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 178/396] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:28 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1699 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:28.793539 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-19894edf-fddf-4d15-a2b8-57944cdd5abc tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:24:28.800153 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-19894edf-fddf-4d15-a2b8-57944cdd5abc tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:28.800757 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-19894edf-fddf-4d15-a2b8-57944cdd5abc tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:28.828084 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-19894edf-fddf-4d15-a2b8-57944cdd5abc tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Going to try to start instance {{(pid=117612) start /opt/stack/nova/nova/compute/api.py:2730}} May 17 17:24:28.998887 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8d8956dc-d1e9-48c1-a575-5c469f95fcd5 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:29.003929 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8d8956dc-d1e9-48c1-a575-5c469f95fcd5 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:29.008960 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8d8956dc-d1e9-48c1-a575-5c469f95fcd5 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:29.009650 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8d8956dc-d1e9-48c1-a575-5c469f95fcd5 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:29.010653 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8d8956dc-d1e9-48c1-a575-5c469f95fcd5 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:29.011344 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8d8956dc-d1e9-48c1-a575-5c469f95fcd5 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:29.084502 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-19894edf-fddf-4d15-a2b8-57944cdd5abc tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "POST /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f/action" status: 202 len: 0 microversion: 2.1 time: 0.294382 May 17 17:24:29.085508 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 219/397] 10.222.0.88 () {60 vars in 1277 bytes} [Tue May 17 17:24:28 2022] POST /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:24:29.093821 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8d8956dc-d1e9-48c1-a575-5c469f95fcd5 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:29.095410 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-529a0d0c-273c-44a0-87eb-74f8dfb54a46 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:29.096187 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-529a0d0c-273c-44a0-87eb-74f8dfb54a46 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:29.102964 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8d8956dc-d1e9-48c1-a575-5c469f95fcd5 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1249 microversion: 2.1 time: 0.108168 May 17 17:24:29.105764 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 179/398] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:28 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1249 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:29.115858 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-529a0d0c-273c-44a0-87eb-74f8dfb54a46 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:29.116488 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-529a0d0c-273c-44a0-87eb-74f8dfb54a46 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:29.117631 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-529a0d0c-273c-44a0-87eb-74f8dfb54a46 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:29.118615 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-529a0d0c-273c-44a0-87eb-74f8dfb54a46 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:29.305283 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-529a0d0c-273c-44a0-87eb-74f8dfb54a46 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:29.314989 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-529a0d0c-273c-44a0-87eb-74f8dfb54a46 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1708 microversion: 2.1 time: 0.225265 May 17 17:24:29.316832 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 220/399] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:29 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1708 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:29.500019 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-9b6a560e-d392-4c46-a539-03545dfcbfee tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:29.500762 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-9b6a560e-d392-4c46-a539-03545dfcbfee tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:29.507446 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9b6a560e-d392-4c46-a539-03545dfcbfee tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:29.508821 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9b6a560e-d392-4c46-a539-03545dfcbfee tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:29.509705 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9b6a560e-d392-4c46-a539-03545dfcbfee tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:29.510366 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9b6a560e-d392-4c46-a539-03545dfcbfee tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:29.730731 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-9b6a560e-d392-4c46-a539-03545dfcbfee tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:29.742026 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-9b6a560e-d392-4c46-a539-03545dfcbfee tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:29.744866 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-9b6a560e-d392-4c46-a539-03545dfcbfee tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:29.746050 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-9b6a560e-d392-4c46-a539-03545dfcbfee tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1723 microversion: 2.20 time: 0.250439 May 17 17:24:29.746590 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 180/400] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:29 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:30.131202 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-9a42ba69-11b1-400d-a792-8a675a0d7ec9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:30.132728 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-9a42ba69-11b1-400d-a792-8a675a0d7ec9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:30.140951 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9a42ba69-11b1-400d-a792-8a675a0d7ec9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:30.142254 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9a42ba69-11b1-400d-a792-8a675a0d7ec9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:30.143350 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9a42ba69-11b1-400d-a792-8a675a0d7ec9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:30.144552 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9a42ba69-11b1-400d-a792-8a675a0d7ec9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:30.268804 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-9a42ba69-11b1-400d-a792-8a675a0d7ec9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:30.275971 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-9a42ba69-11b1-400d-a792-8a675a0d7ec9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1297 microversion: 2.1 time: 0.151259 May 17 17:24:30.276540 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 221/401] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:30 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1297 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:30.332943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b74fd7a1-7660-4482-9a74-b26fcda6f951 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:30.333560 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b74fd7a1-7660-4482-9a74-b26fcda6f951 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:30.349385 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b74fd7a1-7660-4482-9a74-b26fcda6f951 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:30.350111 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b74fd7a1-7660-4482-9a74-b26fcda6f951 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:30.351072 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b74fd7a1-7660-4482-9a74-b26fcda6f951 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:30.351686 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b74fd7a1-7660-4482-9a74-b26fcda6f951 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:30.764656 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-242b95f6-22f2-4a41-b3b6-4b3cef91fa23 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:30.765571 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-242b95f6-22f2-4a41-b3b6-4b3cef91fa23 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:30.771909 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-242b95f6-22f2-4a41-b3b6-4b3cef91fa23 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:30.772568 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-242b95f6-22f2-4a41-b3b6-4b3cef91fa23 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:30.773515 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-242b95f6-22f2-4a41-b3b6-4b3cef91fa23 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:30.774114 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-242b95f6-22f2-4a41-b3b6-4b3cef91fa23 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:30.822024 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b74fd7a1-7660-4482-9a74-b26fcda6f951 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:30.840525 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b74fd7a1-7660-4482-9a74-b26fcda6f951 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1708 microversion: 2.1 time: 0.510256 May 17 17:24:30.847544 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 181/402] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:30 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1708 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:31.022283 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-242b95f6-22f2-4a41-b3b6-4b3cef91fa23 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:31.030940 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-242b95f6-22f2-4a41-b3b6-4b3cef91fa23 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:31.032484 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-242b95f6-22f2-4a41-b3b6-4b3cef91fa23 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:31.033647 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-242b95f6-22f2-4a41-b3b6-4b3cef91fa23 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1744 microversion: 2.20 time: 0.273071 May 17 17:24:31.034204 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 222/403] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:30 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1744 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:24:31.296472 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-bfb98b93-75c1-4b2b-85eb-9308964d0061 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:31.296472 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-bfb98b93-75c1-4b2b-85eb-9308964d0061 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:31.300485 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bfb98b93-75c1-4b2b-85eb-9308964d0061 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:31.301176 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bfb98b93-75c1-4b2b-85eb-9308964d0061 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:31.302441 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bfb98b93-75c1-4b2b-85eb-9308964d0061 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:31.303217 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bfb98b93-75c1-4b2b-85eb-9308964d0061 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:31.426665 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-bfb98b93-75c1-4b2b-85eb-9308964d0061 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:31.434874 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-bfb98b93-75c1-4b2b-85eb-9308964d0061 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1303 microversion: 2.1 time: 0.145060 May 17 17:24:31.438996 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 182/404] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:31 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1303 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:31.860551 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7648744d-a02f-4616-b228-03c970bcfc3e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:31.861463 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-7648744d-a02f-4616-b228-03c970bcfc3e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:31.870850 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7648744d-a02f-4616-b228-03c970bcfc3e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:31.872828 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7648744d-a02f-4616-b228-03c970bcfc3e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:31.875739 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7648744d-a02f-4616-b228-03c970bcfc3e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:31.876286 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7648744d-a02f-4616-b228-03c970bcfc3e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:32.054967 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d7efe204-5033-42cd-aef3-4bfa585f93b6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:32.055638 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d7efe204-5033-42cd-aef3-4bfa585f93b6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:32.067665 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d7efe204-5033-42cd-aef3-4bfa585f93b6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:32.068184 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d7efe204-5033-42cd-aef3-4bfa585f93b6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:32.069005 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d7efe204-5033-42cd-aef3-4bfa585f93b6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:32.069445 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d7efe204-5033-42cd-aef3-4bfa585f93b6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:32.146510 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7648744d-a02f-4616-b228-03c970bcfc3e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:32.156956 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7648744d-a02f-4616-b228-03c970bcfc3e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1708 microversion: 2.1 time: 0.301469 May 17 17:24:32.157836 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 223/405] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:31 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1708 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:32.320626 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d7efe204-5033-42cd-aef3-4bfa585f93b6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:32.329052 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d7efe204-5033-42cd-aef3-4bfa585f93b6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:32.331111 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d7efe204-5033-42cd-aef3-4bfa585f93b6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:32.332525 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d7efe204-5033-42cd-aef3-4bfa585f93b6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1744 microversion: 2.20 time: 0.282646 May 17 17:24:32.333177 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 183/406] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:32 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1744 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:32.454980 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3ddbb8fc-9aa3-47bf-9250-d98445a34f18 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:32.455617 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3ddbb8fc-9aa3-47bf-9250-d98445a34f18 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:32.465131 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3ddbb8fc-9aa3-47bf-9250-d98445a34f18 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:32.465798 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3ddbb8fc-9aa3-47bf-9250-d98445a34f18 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:32.468880 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3ddbb8fc-9aa3-47bf-9250-d98445a34f18 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:32.469338 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3ddbb8fc-9aa3-47bf-9250-d98445a34f18 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:32.670138 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-3ddbb8fc-9aa3-47bf-9250-d98445a34f18 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:32.680316 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3ddbb8fc-9aa3-47bf-9250-d98445a34f18 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1370 microversion: 2.1 time: 0.229061 May 17 17:24:32.688318 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 224/407] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:32 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1370 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:33.175971 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-64bd3028-d27a-4509-a67b-65d27effe166 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:33.177317 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-64bd3028-d27a-4509-a67b-65d27effe166 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:33.198735 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-64bd3028-d27a-4509-a67b-65d27effe166 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:33.202172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-64bd3028-d27a-4509-a67b-65d27effe166 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:33.204146 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-64bd3028-d27a-4509-a67b-65d27effe166 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:33.205946 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-64bd3028-d27a-4509-a67b-65d27effe166 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:33.351756 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6faa3f65-2d15-4b37-a6c9-53c711d36d7e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:33.352377 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6faa3f65-2d15-4b37-a6c9-53c711d36d7e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:33.360809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6faa3f65-2d15-4b37-a6c9-53c711d36d7e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:33.361258 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6faa3f65-2d15-4b37-a6c9-53c711d36d7e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:33.362845 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6faa3f65-2d15-4b37-a6c9-53c711d36d7e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:33.363706 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6faa3f65-2d15-4b37-a6c9-53c711d36d7e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:33.444053 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-64bd3028-d27a-4509-a67b-65d27effe166 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:33.460579 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-64bd3028-d27a-4509-a67b-65d27effe166 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1712 microversion: 2.1 time: 0.290273 May 17 17:24:33.473882 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 184/408] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:33 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1712 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:33.506430 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-25b8bd33-343b-4d1e-a642-49572aa7c0cc req-1b75df7e-6f92-4833-8362-d11b41a72c9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de553cb6-1884-4291-a670-74718d9705e0", "tag": "917f3696-6eaa-402a-9e6a-03c0b7b05692"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:24:33.520207 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-25b8bd33-343b-4d1e-a642-49572aa7c0cc req-1b75df7e-6f92-4833-8362-d11b41a72c9b service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:33.520650 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-25b8bd33-343b-4d1e-a642-49572aa7c0cc req-1b75df7e-6f92-4833-8362-d11b41a72c9b service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:33.546518 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-25b8bd33-343b-4d1e-a642-49572aa7c0cc req-1b75df7e-6f92-4833-8362-d11b41a72c9b service nova] Creating event network-changed:917f3696-6eaa-402a-9e6a-03c0b7b05692 for instance de553cb6-1884-4291-a670-74718d9705e0 on hv-cinder-84214 May 17 17:24:33.559312 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-25b8bd33-343b-4d1e-a642-49572aa7c0cc req-1b75df7e-6f92-4833-8362-d11b41a72c9b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057560 May 17 17:24:33.564719 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 185/409] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:24:33.664615 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-00142cae-3a4e-4910-84bd-3faaa31d08d6 req-926572e8-cbbf-47bb-85e2-c04b442cff04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44", "name": "network-vif-plugged", "status": "completed", "tag": "88984695-6cd9-4b4c-b02c-9f8d26d785d7"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:24:33.667585 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6faa3f65-2d15-4b37-a6c9-53c711d36d7e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:33.676192 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-00142cae-3a4e-4910-84bd-3faaa31d08d6 req-926572e8-cbbf-47bb-85e2-c04b442cff04 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:33.676394 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6faa3f65-2d15-4b37-a6c9-53c711d36d7e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:33.677882 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6faa3f65-2d15-4b37-a6c9-53c711d36d7e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:33.678939 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-00142cae-3a4e-4910-84bd-3faaa31d08d6 req-926572e8-cbbf-47bb-85e2-c04b442cff04 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:33.688457 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6faa3f65-2d15-4b37-a6c9-53c711d36d7e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1739 microversion: 2.20 time: 0.335207 May 17 17:24:33.693336 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 225/410] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:33 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1739 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:33.707225 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-50b1d1b4-9233-4e1f-ae56-7f7762f59601 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:33.708424 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-50b1d1b4-9233-4e1f-ae56-7f7762f59601 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:33.715765 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-50b1d1b4-9233-4e1f-ae56-7f7762f59601 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:33.716431 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-50b1d1b4-9233-4e1f-ae56-7f7762f59601 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:33.716980 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-00142cae-3a4e-4910-84bd-3faaa31d08d6 req-926572e8-cbbf-47bb-85e2-c04b442cff04 service nova] Creating event network-vif-plugged:88984695-6cd9-4b4c-b02c-9f8d26d785d7 for instance bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 on hv-cinder-84214 May 17 17:24:33.717570 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-50b1d1b4-9233-4e1f-ae56-7f7762f59601 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:33.719913 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-50b1d1b4-9233-4e1f-ae56-7f7762f59601 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:33.729410 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-00142cae-3a4e-4910-84bd-3faaa31d08d6 req-926572e8-cbbf-47bb-85e2-c04b442cff04 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081294 May 17 17:24:33.730156 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 186/411] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:24:33.983388 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-50b1d1b4-9233-4e1f-ae56-7f7762f59601 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:33.991973 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-50b1d1b4-9233-4e1f-ae56-7f7762f59601 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1370 microversion: 2.1 time: 0.292835 May 17 17:24:33.993794 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 226/412] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:33 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1370 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:34.714058 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-322f6d5d-5475-41e7-b017-d06b0bdcfb21 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:34.715421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-322f6d5d-5475-41e7-b017-d06b0bdcfb21 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:34.724674 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-322f6d5d-5475-41e7-b017-d06b0bdcfb21 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:34.725304 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-322f6d5d-5475-41e7-b017-d06b0bdcfb21 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:34.727035 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-322f6d5d-5475-41e7-b017-d06b0bdcfb21 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:34.727722 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-322f6d5d-5475-41e7-b017-d06b0bdcfb21 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:34.906334 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-322f6d5d-5475-41e7-b017-d06b0bdcfb21 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:34.914785 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-322f6d5d-5475-41e7-b017-d06b0bdcfb21 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:34.916361 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-322f6d5d-5475-41e7-b017-d06b0bdcfb21 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:34.917746 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-322f6d5d-5475-41e7-b017-d06b0bdcfb21 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1739 microversion: 2.20 time: 0.212633 May 17 17:24:34.918393 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 187/413] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:34 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:35.013723 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1d5e07ae-b099-4864-9bb0-24488e25b0df tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:35.014381 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1d5e07ae-b099-4864-9bb0-24488e25b0df tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:35.021875 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1d5e07ae-b099-4864-9bb0-24488e25b0df tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:35.022585 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1d5e07ae-b099-4864-9bb0-24488e25b0df tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:35.023643 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1d5e07ae-b099-4864-9bb0-24488e25b0df tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:35.024181 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1d5e07ae-b099-4864-9bb0-24488e25b0df tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:35.192737 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1d5e07ae-b099-4864-9bb0-24488e25b0df tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:35.200657 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1d5e07ae-b099-4864-9bb0-24488e25b0df tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1370 microversion: 2.1 time: 0.194101 May 17 17:24:35.202935 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 227/414] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:35 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1370 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:35.937028 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b80f6b98-4b4d-47f2-a232-e3c7a3cf141f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:35.938386 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b80f6b98-4b4d-47f2-a232-e3c7a3cf141f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:35.947225 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b80f6b98-4b4d-47f2-a232-e3c7a3cf141f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:35.947690 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b80f6b98-4b4d-47f2-a232-e3c7a3cf141f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:35.948475 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b80f6b98-4b4d-47f2-a232-e3c7a3cf141f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:35.949088 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b80f6b98-4b4d-47f2-a232-e3c7a3cf141f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:36.114101 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b80f6b98-4b4d-47f2-a232-e3c7a3cf141f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:36.122428 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b80f6b98-4b4d-47f2-a232-e3c7a3cf141f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:36.123982 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b80f6b98-4b4d-47f2-a232-e3c7a3cf141f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:36.125156 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b80f6b98-4b4d-47f2-a232-e3c7a3cf141f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1739 microversion: 2.20 time: 0.192977 May 17 17:24:36.135786 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 188/415] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:35 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:36.219041 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d7a6e2c3-fee6-4d14-b119-203a5baf69c4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:36.220210 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d7a6e2c3-fee6-4d14-b119-203a5baf69c4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:36.226689 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d7a6e2c3-fee6-4d14-b119-203a5baf69c4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:36.227368 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d7a6e2c3-fee6-4d14-b119-203a5baf69c4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:36.231175 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d7a6e2c3-fee6-4d14-b119-203a5baf69c4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:36.232016 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d7a6e2c3-fee6-4d14-b119-203a5baf69c4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:36.377243 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d7a6e2c3-fee6-4d14-b119-203a5baf69c4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:36.395002 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d7a6e2c3-fee6-4d14-b119-203a5baf69c4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1370 microversion: 2.1 time: 0.180324 May 17 17:24:36.404118 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 228/416] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:36 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:37.170443 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-081e20e3-55ab-400b-a25e-2ca22c4903c7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:37.170443 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-081e20e3-55ab-400b-a25e-2ca22c4903c7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:37.170443 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-081e20e3-55ab-400b-a25e-2ca22c4903c7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:37.170443 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-081e20e3-55ab-400b-a25e-2ca22c4903c7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:37.171874 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-081e20e3-55ab-400b-a25e-2ca22c4903c7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:37.171874 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-081e20e3-55ab-400b-a25e-2ca22c4903c7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:37.320237 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-081e20e3-55ab-400b-a25e-2ca22c4903c7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:37.328097 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-081e20e3-55ab-400b-a25e-2ca22c4903c7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:37.329576 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-081e20e3-55ab-400b-a25e-2ca22c4903c7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:37.330710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-081e20e3-55ab-400b-a25e-2ca22c4903c7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1739 microversion: 2.20 time: 0.191021 May 17 17:24:37.331306 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 189/417] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:37 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:37.422280 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-aea2dd6b-4a9b-417b-afdc-3fad6b10209b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:37.422830 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-aea2dd6b-4a9b-417b-afdc-3fad6b10209b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:37.428973 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-aea2dd6b-4a9b-417b-afdc-3fad6b10209b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:37.429501 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-aea2dd6b-4a9b-417b-afdc-3fad6b10209b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:37.430314 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-aea2dd6b-4a9b-417b-afdc-3fad6b10209b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:37.430760 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-aea2dd6b-4a9b-417b-afdc-3fad6b10209b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:37.599777 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-aea2dd6b-4a9b-417b-afdc-3fad6b10209b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:37.609849 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-aea2dd6b-4a9b-417b-afdc-3fad6b10209b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1370 microversion: 2.1 time: 0.191857 May 17 17:24:37.622409 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 229/418] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:37 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1370 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:38.349798 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ce806e60-25f6-4f44-bbfb-766abfa7d662 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:38.350324 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ce806e60-25f6-4f44-bbfb-766abfa7d662 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:38.360914 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ce806e60-25f6-4f44-bbfb-766abfa7d662 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:38.361461 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ce806e60-25f6-4f44-bbfb-766abfa7d662 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:38.362335 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ce806e60-25f6-4f44-bbfb-766abfa7d662 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:38.362842 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ce806e60-25f6-4f44-bbfb-766abfa7d662 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:38.523376 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ce806e60-25f6-4f44-bbfb-766abfa7d662 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:38.531988 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ce806e60-25f6-4f44-bbfb-766abfa7d662 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:38.534238 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ce806e60-25f6-4f44-bbfb-766abfa7d662 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:38.540855 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ce806e60-25f6-4f44-bbfb-766abfa7d662 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1739 microversion: 2.20 time: 0.195239 May 17 17:24:38.541421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 190/419] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:38 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:24:38.626876 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2136fcab-881b-417d-adda-89de5cdcea05 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:38.627904 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2136fcab-881b-417d-adda-89de5cdcea05 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:38.634316 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2136fcab-881b-417d-adda-89de5cdcea05 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:38.634984 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2136fcab-881b-417d-adda-89de5cdcea05 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:38.636163 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2136fcab-881b-417d-adda-89de5cdcea05 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:38.638919 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2136fcab-881b-417d-adda-89de5cdcea05 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:38.779923 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2136fcab-881b-417d-adda-89de5cdcea05 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:38.787905 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2136fcab-881b-417d-adda-89de5cdcea05 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1370 microversion: 2.1 time: 0.165356 May 17 17:24:38.788700 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 230/420] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:38 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:39.559939 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f00882c9-10b4-4789-9bac-fe4eeafb56dd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:39.560557 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f00882c9-10b4-4789-9bac-fe4eeafb56dd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:39.568452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f00882c9-10b4-4789-9bac-fe4eeafb56dd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:39.572831 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f00882c9-10b4-4789-9bac-fe4eeafb56dd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:39.572831 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f00882c9-10b4-4789-9bac-fe4eeafb56dd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:39.572831 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f00882c9-10b4-4789-9bac-fe4eeafb56dd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:39.744857 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f00882c9-10b4-4789-9bac-fe4eeafb56dd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:39.753990 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f00882c9-10b4-4789-9bac-fe4eeafb56dd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:39.755497 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f00882c9-10b4-4789-9bac-fe4eeafb56dd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:39.756831 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f00882c9-10b4-4789-9bac-fe4eeafb56dd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1739 microversion: 2.20 time: 0.200799 May 17 17:24:39.757389 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 191/421] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:39 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:39.805921 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-62f71453-6c6b-4787-99e0-5b31a3ad6074 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:39.806531 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-62f71453-6c6b-4787-99e0-5b31a3ad6074 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:39.814436 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-62f71453-6c6b-4787-99e0-5b31a3ad6074 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:39.814884 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-62f71453-6c6b-4787-99e0-5b31a3ad6074 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:39.815742 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-62f71453-6c6b-4787-99e0-5b31a3ad6074 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:39.816178 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-62f71453-6c6b-4787-99e0-5b31a3ad6074 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:39.971493 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-62f71453-6c6b-4787-99e0-5b31a3ad6074 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:39.984811 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-62f71453-6c6b-4787-99e0-5b31a3ad6074 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1370 microversion: 2.1 time: 0.183070 May 17 17:24:40.005819 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 231/422] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:39 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1370 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:40.349227 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-29416d6f-d615-44c2-84b3-2f26b8c9b536 req-ad38e695-ca1b-42b5-9fe5-7ec43b131ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de553cb6-1884-4291-a670-74718d9705e0", "name": "network-vif-plugged", "status": "completed", "tag": "917f3696-6eaa-402a-9e6a-03c0b7b05692"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:24:40.358963 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-29416d6f-d615-44c2-84b3-2f26b8c9b536 req-ad38e695-ca1b-42b5-9fe5-7ec43b131ee1 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:40.359411 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-29416d6f-d615-44c2-84b3-2f26b8c9b536 req-ad38e695-ca1b-42b5-9fe5-7ec43b131ee1 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:40.373258 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-29416d6f-d615-44c2-84b3-2f26b8c9b536 req-ad38e695-ca1b-42b5-9fe5-7ec43b131ee1 service nova] Creating event network-vif-plugged:917f3696-6eaa-402a-9e6a-03c0b7b05692 for instance de553cb6-1884-4291-a670-74718d9705e0 on hv-cinder-84214 May 17 17:24:40.378845 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-29416d6f-d615-44c2-84b3-2f26b8c9b536 req-ad38e695-ca1b-42b5-9fe5-7ec43b131ee1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036719 May 17 17:24:40.379442 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 192/423] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:24:40.775399 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f5579525-04c7-4bae-8f22-f38df6195b95 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:40.776044 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f5579525-04c7-4bae-8f22-f38df6195b95 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:40.782365 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f5579525-04c7-4bae-8f22-f38df6195b95 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:40.782811 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f5579525-04c7-4bae-8f22-f38df6195b95 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:40.783599 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f5579525-04c7-4bae-8f22-f38df6195b95 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:40.784031 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f5579525-04c7-4bae-8f22-f38df6195b95 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:40.915997 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f5579525-04c7-4bae-8f22-f38df6195b95 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:40.924673 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f5579525-04c7-4bae-8f22-f38df6195b95 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:40.926153 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f5579525-04c7-4bae-8f22-f38df6195b95 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:40.927297 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f5579525-04c7-4bae-8f22-f38df6195b95 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1739 microversion: 2.20 time: 0.155812 May 17 17:24:40.927877 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 232/424] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:40 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:41.003915 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-219115d2-38e6-483a-98dc-46e1da58dd80 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:41.004615 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-219115d2-38e6-483a-98dc-46e1da58dd80 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:41.011205 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-219115d2-38e6-483a-98dc-46e1da58dd80 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:41.011847 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-219115d2-38e6-483a-98dc-46e1da58dd80 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:41.012677 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-219115d2-38e6-483a-98dc-46e1da58dd80 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:41.013118 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-219115d2-38e6-483a-98dc-46e1da58dd80 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:41.162828 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-219115d2-38e6-483a-98dc-46e1da58dd80 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:41.176105 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-219115d2-38e6-483a-98dc-46e1da58dd80 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1370 microversion: 2.1 time: 0.176256 May 17 17:24:41.191991 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 193/425] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:40 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:41.950020 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ba1d2839-6798-4b81-bcdd-b51d52375725 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:41.952002 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ba1d2839-6798-4b81-bcdd-b51d52375725 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:41.978903 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ba1d2839-6798-4b81-bcdd-b51d52375725 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:41.979799 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ba1d2839-6798-4b81-bcdd-b51d52375725 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:41.981380 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ba1d2839-6798-4b81-bcdd-b51d52375725 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:41.982435 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ba1d2839-6798-4b81-bcdd-b51d52375725 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:42.135010 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ba1d2839-6798-4b81-bcdd-b51d52375725 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:42.144010 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ba1d2839-6798-4b81-bcdd-b51d52375725 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:42.145800 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ba1d2839-6798-4b81-bcdd-b51d52375725 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:42.147029 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ba1d2839-6798-4b81-bcdd-b51d52375725 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1739 microversion: 2.20 time: 0.201031 May 17 17:24:42.147832 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 233/426] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:41 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:42.193913 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-264cf0d8-db73-45f4-ade7-fb3ea06255b8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:42.195420 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-264cf0d8-db73-45f4-ade7-fb3ea06255b8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:42.204423 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-264cf0d8-db73-45f4-ade7-fb3ea06255b8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:42.205124 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-264cf0d8-db73-45f4-ade7-fb3ea06255b8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:42.206115 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-264cf0d8-db73-45f4-ade7-fb3ea06255b8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:42.206710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-264cf0d8-db73-45f4-ade7-fb3ea06255b8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:42.346667 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-264cf0d8-db73-45f4-ade7-fb3ea06255b8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:42.354850 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-264cf0d8-db73-45f4-ade7-fb3ea06255b8 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1370 microversion: 2.1 time: 0.164878 May 17 17:24:42.365158 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 194/427] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:42 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:43.166443 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b5334612-2de5-4821-9ffe-fd37c6e04e17 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:43.167320 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b5334612-2de5-4821-9ffe-fd37c6e04e17 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:43.173339 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b5334612-2de5-4821-9ffe-fd37c6e04e17 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:43.174007 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b5334612-2de5-4821-9ffe-fd37c6e04e17 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:43.174949 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b5334612-2de5-4821-9ffe-fd37c6e04e17 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:43.175855 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b5334612-2de5-4821-9ffe-fd37c6e04e17 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:43.337459 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b5334612-2de5-4821-9ffe-fd37c6e04e17 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:43.346818 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b5334612-2de5-4821-9ffe-fd37c6e04e17 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:43.348440 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b5334612-2de5-4821-9ffe-fd37c6e04e17 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:43.350126 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b5334612-2de5-4821-9ffe-fd37c6e04e17 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1739 microversion: 2.20 time: 0.187491 May 17 17:24:43.361111 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 234/428] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:43 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:43.372541 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e7a78d66-d61d-417d-9de8-92eb9ea8e34f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:43.373669 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e7a78d66-d61d-417d-9de8-92eb9ea8e34f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:43.380174 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e7a78d66-d61d-417d-9de8-92eb9ea8e34f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:43.380625 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e7a78d66-d61d-417d-9de8-92eb9ea8e34f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:43.381402 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e7a78d66-d61d-417d-9de8-92eb9ea8e34f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:43.381840 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e7a78d66-d61d-417d-9de8-92eb9ea8e34f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:43.527316 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e7a78d66-d61d-417d-9de8-92eb9ea8e34f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:43.535637 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e7a78d66-d61d-417d-9de8-92eb9ea8e34f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1370 microversion: 2.1 time: 0.167037 May 17 17:24:43.536220 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 195/429] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:43 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:44.368754 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-91c88f91-08d9-4fd5-b456-254b900cee13 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:44.369454 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-91c88f91-08d9-4fd5-b456-254b900cee13 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:44.376293 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-91c88f91-08d9-4fd5-b456-254b900cee13 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:44.381296 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-91c88f91-08d9-4fd5-b456-254b900cee13 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:44.381296 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-91c88f91-08d9-4fd5-b456-254b900cee13 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:44.381296 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-91c88f91-08d9-4fd5-b456-254b900cee13 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:44.548546 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-91c88f91-08d9-4fd5-b456-254b900cee13 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:44.560254 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-91c88f91-08d9-4fd5-b456-254b900cee13 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:44.562752 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-91c88f91-08d9-4fd5-b456-254b900cee13 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:44.563106 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-cb45a7dd-2651-446d-ad55-586e91a3b5a7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:44.563641 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-cb45a7dd-2651-446d-ad55-586e91a3b5a7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:44.564200 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-91c88f91-08d9-4fd5-b456-254b900cee13 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1739 microversion: 2.20 time: 0.199348 May 17 17:24:44.565277 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 235/430] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:44 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:44.578331 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cb45a7dd-2651-446d-ad55-586e91a3b5a7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:44.578775 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cb45a7dd-2651-446d-ad55-586e91a3b5a7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:44.579768 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cb45a7dd-2651-446d-ad55-586e91a3b5a7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:44.580404 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cb45a7dd-2651-446d-ad55-586e91a3b5a7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:44.769576 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-cb45a7dd-2651-446d-ad55-586e91a3b5a7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:44.777556 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-cb45a7dd-2651-446d-ad55-586e91a3b5a7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1370 microversion: 2.1 time: 0.227999 May 17 17:24:44.778202 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 196/431] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:44 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1370 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:24:45.583384 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f8490198-cd10-47ba-82eb-9bcff3f1a3ec tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:45.584009 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f8490198-cd10-47ba-82eb-9bcff3f1a3ec tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:45.590041 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f8490198-cd10-47ba-82eb-9bcff3f1a3ec tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:45.590743 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f8490198-cd10-47ba-82eb-9bcff3f1a3ec tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:45.591542 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f8490198-cd10-47ba-82eb-9bcff3f1a3ec tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:45.592000 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f8490198-cd10-47ba-82eb-9bcff3f1a3ec tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:45.743091 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f8490198-cd10-47ba-82eb-9bcff3f1a3ec tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:45.753215 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f8490198-cd10-47ba-82eb-9bcff3f1a3ec tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:45.755699 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f8490198-cd10-47ba-82eb-9bcff3f1a3ec tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:45.757126 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f8490198-cd10-47ba-82eb-9bcff3f1a3ec tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1739 microversion: 2.20 time: 0.178169 May 17 17:24:45.757761 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 236/432] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:45 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:45.794589 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-33689cd6-0a48-4c1f-a41c-76f1c1b1d24e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:45.795195 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-33689cd6-0a48-4c1f-a41c-76f1c1b1d24e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:45.802141 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-33689cd6-0a48-4c1f-a41c-76f1c1b1d24e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:45.802632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-33689cd6-0a48-4c1f-a41c-76f1c1b1d24e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:45.803426 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-33689cd6-0a48-4c1f-a41c-76f1c1b1d24e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:45.803886 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-33689cd6-0a48-4c1f-a41c-76f1c1b1d24e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:45.932871 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-33689cd6-0a48-4c1f-a41c-76f1c1b1d24e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:45.940324 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-33689cd6-0a48-4c1f-a41c-76f1c1b1d24e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1565 microversion: 2.1 time: 0.149541 May 17 17:24:45.940886 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 197/433] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:24:45 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:24:45.956378 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-62bf88e2-38b9-43a5-b9ff-489a0963725c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:45.956924 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-62bf88e2-38b9-43a5-b9ff-489a0963725c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:45.963193 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-62bf88e2-38b9-43a5-b9ff-489a0963725c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:45.965385 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-62bf88e2-38b9-43a5-b9ff-489a0963725c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:45.965385 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-62bf88e2-38b9-43a5-b9ff-489a0963725c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:45.965385 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-62bf88e2-38b9-43a5-b9ff-489a0963725c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:46.043265 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-62bf88e2-38b9-43a5-b9ff-489a0963725c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090797 May 17 17:24:46.044100 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 237/434] 10.222.0.88 () {58 vars in 1274 bytes} [Tue May 17 17:24:45 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:24:46.775387 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6224e3d7-758d-4289-bec3-1c20d4042c41 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:46.776035 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6224e3d7-758d-4289-bec3-1c20d4042c41 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:46.782902 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6224e3d7-758d-4289-bec3-1c20d4042c41 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:46.783354 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6224e3d7-758d-4289-bec3-1c20d4042c41 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:46.784161 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6224e3d7-758d-4289-bec3-1c20d4042c41 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:46.784802 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6224e3d7-758d-4289-bec3-1c20d4042c41 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:46.978810 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6224e3d7-758d-4289-bec3-1c20d4042c41 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:46.989850 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6224e3d7-758d-4289-bec3-1c20d4042c41 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:46.991720 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6224e3d7-758d-4289-bec3-1c20d4042c41 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:46.993038 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6224e3d7-758d-4289-bec3-1c20d4042c41 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1721 microversion: 2.20 time: 0.221493 May 17 17:24:46.993776 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 198/435] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:46 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:47.126239 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-6890808e-7fbe-494c-95c1-092c3694c2b5 req-7e2f7f07-713b-4848-8ace-a0f92cb101e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de553cb6-1884-4291-a670-74718d9705e0", "tag": "917f3696-6eaa-402a-9e6a-03c0b7b05692"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:24:47.134772 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-6890808e-7fbe-494c-95c1-092c3694c2b5 req-7e2f7f07-713b-4848-8ace-a0f92cb101e1 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:47.135212 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-6890808e-7fbe-494c-95c1-092c3694c2b5 req-7e2f7f07-713b-4848-8ace-a0f92cb101e1 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:47.149346 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-6890808e-7fbe-494c-95c1-092c3694c2b5 req-7e2f7f07-713b-4848-8ace-a0f92cb101e1 service nova] Creating event network-changed:917f3696-6eaa-402a-9e6a-03c0b7b05692 for instance de553cb6-1884-4291-a670-74718d9705e0 on hv-cinder-84214 May 17 17:24:47.154677 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-6890808e-7fbe-494c-95c1-092c3694c2b5 req-7e2f7f07-713b-4848-8ace-a0f92cb101e1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032644 May 17 17:24:47.155440 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 238/436] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:24:48.012658 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3180a0c7-861c-40d8-af85-ea41565b3c68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:48.013276 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3180a0c7-861c-40d8-af85-ea41565b3c68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:48.019676 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3180a0c7-861c-40d8-af85-ea41565b3c68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:48.020130 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3180a0c7-861c-40d8-af85-ea41565b3c68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:48.020905 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3180a0c7-861c-40d8-af85-ea41565b3c68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:48.021349 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3180a0c7-861c-40d8-af85-ea41565b3c68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:48.151288 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3180a0c7-861c-40d8-af85-ea41565b3c68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:48.159871 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3180a0c7-861c-40d8-af85-ea41565b3c68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:48.161347 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3180a0c7-861c-40d8-af85-ea41565b3c68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:48.162498 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3180a0c7-861c-40d8-af85-ea41565b3c68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1721 microversion: 2.20 time: 0.154750 May 17 17:24:48.163101 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 199/437] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:48 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:49.182179 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4b0d57a0-0b00-4be7-b3c2-7bd028371d4f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:49.183022 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4b0d57a0-0b00-4be7-b3c2-7bd028371d4f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:49.190178 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4b0d57a0-0b00-4be7-b3c2-7bd028371d4f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:49.190992 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4b0d57a0-0b00-4be7-b3c2-7bd028371d4f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:49.191939 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4b0d57a0-0b00-4be7-b3c2-7bd028371d4f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:49.192553 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4b0d57a0-0b00-4be7-b3c2-7bd028371d4f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:49.329550 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4b0d57a0-0b00-4be7-b3c2-7bd028371d4f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:49.337344 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4b0d57a0-0b00-4be7-b3c2-7bd028371d4f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:49.338836 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4b0d57a0-0b00-4be7-b3c2-7bd028371d4f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:49.340013 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4b0d57a0-0b00-4be7-b3c2-7bd028371d4f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1724 microversion: 2.20 time: 0.162523 May 17 17:24:49.340574 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 239/438] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:49 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:49.358425 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6e9adb0b-e3bc-4ad8-816f-5b4c64a5aeb7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92e329e7-7df9-4687-abeb-c7c82530dc90"}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:24:49.359542 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6e9adb0b-e3bc-4ad8-816f-5b4c64a5aeb7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:49.365790 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6e9adb0b-e3bc-4ad8-816f-5b4c64a5aeb7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:49.366235 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6e9adb0b-e3bc-4ad8-816f-5b4c64a5aeb7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:49.366996 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6e9adb0b-e3bc-4ad8-816f-5b4c64a5aeb7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:49.367427 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6e9adb0b-e3bc-4ad8-816f-5b4c64a5aeb7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:50.394535 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6e9adb0b-e3bc-4ad8-816f-5b4c64a5aeb7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "POST /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.040030 May 17 17:24:50.395184 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 200/439] 10.222.0.88 () {62 vars in 1363 bytes} [Tue May 17 17:24:49 2022] POST /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44/os-volume_attachments => generated 188 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 17:24:50.504994 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-610edf99-aef8-4b63-abac-63585794d105 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:24:50.505562 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-610edf99-aef8-4b63-abac-63585794d105 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:50.511420 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-610edf99-aef8-4b63-abac-63585794d105 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:50.512070 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-610edf99-aef8-4b63-abac-63585794d105 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:50.512883 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-610edf99-aef8-4b63-abac-63585794d105 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:50.513323 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-610edf99-aef8-4b63-abac-63585794d105 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:50.756683 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-610edf99-aef8-4b63-abac-63585794d105 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "POST /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44/action" status: 202 len: 0 microversion: 2.20 time: 0.255624 May 17 17:24:50.757384 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 240/440] 10.222.0.88 () {62 vars in 1318 bytes} [Tue May 17 17:24:50 2022] POST /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 17:24:50.765799 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a7bbd652-f114-43ee-ad50-dec02f9068d3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:50.766400 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a7bbd652-f114-43ee-ad50-dec02f9068d3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:50.772861 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a7bbd652-f114-43ee-ad50-dec02f9068d3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:50.773311 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a7bbd652-f114-43ee-ad50-dec02f9068d3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:50.774076 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a7bbd652-f114-43ee-ad50-dec02f9068d3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:50.774511 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a7bbd652-f114-43ee-ad50-dec02f9068d3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:50.904886 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a7bbd652-f114-43ee-ad50-dec02f9068d3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:50.913935 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a7bbd652-f114-43ee-ad50-dec02f9068d3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:50.915428 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a7bbd652-f114-43ee-ad50-dec02f9068d3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:50.916609 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a7bbd652-f114-43ee-ad50-dec02f9068d3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1810 microversion: 2.20 time: 0.155196 May 17 17:24:50.917182 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 201/441] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:50 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:51.912782 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-3ab981ab-e351-4da0-8c1c-9ba92bccdb9c req-a00ff16d-8094-45eb-9f8f-b25efd8068e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44", "name": "network-vif-unplugged", "status": "completed", "tag": "88984695-6cd9-4b4c-b02c-9f8d26d785d7"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:24:51.920871 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-3ab981ab-e351-4da0-8c1c-9ba92bccdb9c req-a00ff16d-8094-45eb-9f8f-b25efd8068e3 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:51.921305 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-3ab981ab-e351-4da0-8c1c-9ba92bccdb9c req-a00ff16d-8094-45eb-9f8f-b25efd8068e3 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:51.934863 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-2bc5eb32-8456-4d62-88d5-1613ac8ad83c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:51.935485 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-2bc5eb32-8456-4d62-88d5-1613ac8ad83c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:51.936323 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-3ab981ab-e351-4da0-8c1c-9ba92bccdb9c req-a00ff16d-8094-45eb-9f8f-b25efd8068e3 service nova] Creating event network-vif-unplugged:88984695-6cd9-4b4c-b02c-9f8d26d785d7 for instance bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 on hv-cinder-84214 May 17 17:24:51.941427 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-3ab981ab-e351-4da0-8c1c-9ba92bccdb9c req-a00ff16d-8094-45eb-9f8f-b25efd8068e3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032880 May 17 17:24:51.941637 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2bc5eb32-8456-4d62-88d5-1613ac8ad83c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:51.942065 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 241/442] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:24:51.942327 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2bc5eb32-8456-4d62-88d5-1613ac8ad83c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:51.943110 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2bc5eb32-8456-4d62-88d5-1613ac8ad83c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:51.943649 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2bc5eb32-8456-4d62-88d5-1613ac8ad83c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:52.083295 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2bc5eb32-8456-4d62-88d5-1613ac8ad83c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:52.091769 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2bc5eb32-8456-4d62-88d5-1613ac8ad83c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:52.093444 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2bc5eb32-8456-4d62-88d5-1613ac8ad83c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:52.094607 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-2bc5eb32-8456-4d62-88d5-1613ac8ad83c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1810 microversion: 2.20 time: 0.163902 May 17 17:24:52.095171 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 202/443] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:51 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:24:53.114461 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b8591f5c-0c6d-4ae3-b308-35ab5bc1d45c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:53.115149 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b8591f5c-0c6d-4ae3-b308-35ab5bc1d45c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:53.121359 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b8591f5c-0c6d-4ae3-b308-35ab5bc1d45c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:53.121805 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b8591f5c-0c6d-4ae3-b308-35ab5bc1d45c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:53.122884 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b8591f5c-0c6d-4ae3-b308-35ab5bc1d45c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:53.123498 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b8591f5c-0c6d-4ae3-b308-35ab5bc1d45c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:53.252002 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b8591f5c-0c6d-4ae3-b308-35ab5bc1d45c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:53.260391 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b8591f5c-0c6d-4ae3-b308-35ab5bc1d45c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:53.262247 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b8591f5c-0c6d-4ae3-b308-35ab5bc1d45c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:53.263389 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b8591f5c-0c6d-4ae3-b308-35ab5bc1d45c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1752 microversion: 2.20 time: 0.154289 May 17 17:24:53.263969 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 242/444] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:53 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:54.282044 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f948806b-decc-47ed-b5bd-42fd65f14c68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:54.282647 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f948806b-decc-47ed-b5bd-42fd65f14c68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:54.288613 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f948806b-decc-47ed-b5bd-42fd65f14c68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:54.289064 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f948806b-decc-47ed-b5bd-42fd65f14c68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:54.289822 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f948806b-decc-47ed-b5bd-42fd65f14c68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:54.290258 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f948806b-decc-47ed-b5bd-42fd65f14c68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:54.418380 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f948806b-decc-47ed-b5bd-42fd65f14c68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:54.426410 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f948806b-decc-47ed-b5bd-42fd65f14c68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:54.427930 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f948806b-decc-47ed-b5bd-42fd65f14c68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:54.429064 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f948806b-decc-47ed-b5bd-42fd65f14c68 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1752 microversion: 2.20 time: 0.151310 May 17 17:24:54.429622 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 203/445] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:54 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:55.447815 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-05145877-2747-41bb-8f96-7f3ed91cb323 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:55.448420 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-05145877-2747-41bb-8f96-7f3ed91cb323 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:55.454469 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-05145877-2747-41bb-8f96-7f3ed91cb323 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:55.454915 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-05145877-2747-41bb-8f96-7f3ed91cb323 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:55.455714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-05145877-2747-41bb-8f96-7f3ed91cb323 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:55.456206 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-05145877-2747-41bb-8f96-7f3ed91cb323 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:55.581298 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-05145877-2747-41bb-8f96-7f3ed91cb323 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:55.589521 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-05145877-2747-41bb-8f96-7f3ed91cb323 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:55.591010 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-05145877-2747-41bb-8f96-7f3ed91cb323 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:55.592273 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-05145877-2747-41bb-8f96-7f3ed91cb323 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1752 microversion: 2.20 time: 0.148557 May 17 17:24:55.592803 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 243/446] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:55 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:56.611801 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8e83859a-7025-4a1f-8519-9d32fa042d79 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:56.612403 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8e83859a-7025-4a1f-8519-9d32fa042d79 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:56.619824 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8e83859a-7025-4a1f-8519-9d32fa042d79 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:56.620285 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8e83859a-7025-4a1f-8519-9d32fa042d79 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:56.622239 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8e83859a-7025-4a1f-8519-9d32fa042d79 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:56.622239 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8e83859a-7025-4a1f-8519-9d32fa042d79 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:56.758318 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8e83859a-7025-4a1f-8519-9d32fa042d79 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:56.766986 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8e83859a-7025-4a1f-8519-9d32fa042d79 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:56.768505 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8e83859a-7025-4a1f-8519-9d32fa042d79 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:56.769638 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8e83859a-7025-4a1f-8519-9d32fa042d79 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1752 microversion: 2.20 time: 0.162253 May 17 17:24:56.770195 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 204/447] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:56 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:57.787986 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-bb845335-2999-49ee-9be8-f9948ddcd493 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:57.788621 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-bb845335-2999-49ee-9be8-f9948ddcd493 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:57.794673 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bb845335-2999-49ee-9be8-f9948ddcd493 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:57.795114 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bb845335-2999-49ee-9be8-f9948ddcd493 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:57.795933 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bb845335-2999-49ee-9be8-f9948ddcd493 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:57.796939 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bb845335-2999-49ee-9be8-f9948ddcd493 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:57.923849 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-bb845335-2999-49ee-9be8-f9948ddcd493 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:57.931998 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-bb845335-2999-49ee-9be8-f9948ddcd493 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:57.933467 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-bb845335-2999-49ee-9be8-f9948ddcd493 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:57.934592 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-bb845335-2999-49ee-9be8-f9948ddcd493 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1752 microversion: 2.20 time: 0.150442 May 17 17:24:57.935141 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 244/448] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:57 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:24:58.952558 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d836ae5e-f6e4-40dd-8322-678d058f0629 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:24:58.953166 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d836ae5e-f6e4-40dd-8322-678d058f0629 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:24:58.959640 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d836ae5e-f6e4-40dd-8322-678d058f0629 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:58.960091 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d836ae5e-f6e4-40dd-8322-678d058f0629 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:58.960856 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d836ae5e-f6e4-40dd-8322-678d058f0629 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:24:58.961292 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d836ae5e-f6e4-40dd-8322-678d058f0629 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:24:59.084094 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d836ae5e-f6e4-40dd-8322-678d058f0629 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:59.092260 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d836ae5e-f6e4-40dd-8322-678d058f0629 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:59.093750 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d836ae5e-f6e4-40dd-8322-678d058f0629 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:24:59.094884 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d836ae5e-f6e4-40dd-8322-678d058f0629 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1752 microversion: 2.20 time: 0.146200 May 17 17:24:59.095442 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 205/449] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:24:58 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1752 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:00.112659 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d511567d-07a0-419d-a411-8d9dd8e9b63c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:00.113254 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d511567d-07a0-419d-a411-8d9dd8e9b63c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:00.119362 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d511567d-07a0-419d-a411-8d9dd8e9b63c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:00.119854 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d511567d-07a0-419d-a411-8d9dd8e9b63c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:00.120656 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d511567d-07a0-419d-a411-8d9dd8e9b63c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:00.121107 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d511567d-07a0-419d-a411-8d9dd8e9b63c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:00.247765 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d511567d-07a0-419d-a411-8d9dd8e9b63c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:00.260872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d511567d-07a0-419d-a411-8d9dd8e9b63c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:00.260872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d511567d-07a0-419d-a411-8d9dd8e9b63c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:00.260872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d511567d-07a0-419d-a411-8d9dd8e9b63c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1752 microversion: 2.20 time: 0.150523 May 17 17:25:00.261168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 245/450] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:00 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:01.279147 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-23824643-f6ce-4e54-b9cd-f0a9e6e5ce5b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:01.279846 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-23824643-f6ce-4e54-b9cd-f0a9e6e5ce5b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:01.286478 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-23824643-f6ce-4e54-b9cd-f0a9e6e5ce5b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:01.286997 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-23824643-f6ce-4e54-b9cd-f0a9e6e5ce5b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:01.287913 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-23824643-f6ce-4e54-b9cd-f0a9e6e5ce5b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:01.288608 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-23824643-f6ce-4e54-b9cd-f0a9e6e5ce5b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:01.426991 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-23824643-f6ce-4e54-b9cd-f0a9e6e5ce5b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:01.435242 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-23824643-f6ce-4e54-b9cd-f0a9e6e5ce5b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:01.436931 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-23824643-f6ce-4e54-b9cd-f0a9e6e5ce5b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:01.438131 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-23824643-f6ce-4e54-b9cd-f0a9e6e5ce5b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.163758 May 17 17:25:01.438641 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 206/451] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:01 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:02.456340 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-74386810-2d95-407b-a5eb-c59c6810eb5d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:02.456951 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-74386810-2d95-407b-a5eb-c59c6810eb5d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:02.463210 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-74386810-2d95-407b-a5eb-c59c6810eb5d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:02.463714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-74386810-2d95-407b-a5eb-c59c6810eb5d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:02.464497 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-74386810-2d95-407b-a5eb-c59c6810eb5d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:02.464917 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-74386810-2d95-407b-a5eb-c59c6810eb5d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:02.618429 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-74386810-2d95-407b-a5eb-c59c6810eb5d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:02.627224 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-74386810-2d95-407b-a5eb-c59c6810eb5d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:02.628782 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-74386810-2d95-407b-a5eb-c59c6810eb5d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:02.629935 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-74386810-2d95-407b-a5eb-c59c6810eb5d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.177468 May 17 17:25:02.641325 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 246/452] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:02 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:03.649030 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-36593be9-bb8e-46c9-84bd-44bc3898d95c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:03.649627 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-36593be9-bb8e-46c9-84bd-44bc3898d95c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:03.656753 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-36593be9-bb8e-46c9-84bd-44bc3898d95c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:03.657208 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-36593be9-bb8e-46c9-84bd-44bc3898d95c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:03.657998 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-36593be9-bb8e-46c9-84bd-44bc3898d95c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:03.658431 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-36593be9-bb8e-46c9-84bd-44bc3898d95c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:03.789772 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-36593be9-bb8e-46c9-84bd-44bc3898d95c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:03.798016 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-36593be9-bb8e-46c9-84bd-44bc3898d95c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:03.799534 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-36593be9-bb8e-46c9-84bd-44bc3898d95c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:03.800700 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-36593be9-bb8e-46c9-84bd-44bc3898d95c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.155854 May 17 17:25:03.801262 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 207/453] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:03 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:04.818631 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b9304955-6197-4dbf-99e1-0b1ebc2cb501 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:04.819240 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b9304955-6197-4dbf-99e1-0b1ebc2cb501 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:04.825207 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b9304955-6197-4dbf-99e1-0b1ebc2cb501 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:04.825667 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b9304955-6197-4dbf-99e1-0b1ebc2cb501 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:04.826509 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b9304955-6197-4dbf-99e1-0b1ebc2cb501 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:04.826953 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b9304955-6197-4dbf-99e1-0b1ebc2cb501 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:04.972471 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b9304955-6197-4dbf-99e1-0b1ebc2cb501 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:04.984762 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b9304955-6197-4dbf-99e1-0b1ebc2cb501 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:04.986484 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b9304955-6197-4dbf-99e1-0b1ebc2cb501 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:04.988092 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b9304955-6197-4dbf-99e1-0b1ebc2cb501 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.173188 May 17 17:25:04.990202 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 247/454] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:04 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:06.010290 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-684531d7-79d4-4f47-adc8-a500296c2c7a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:06.011698 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-684531d7-79d4-4f47-adc8-a500296c2c7a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:06.020007 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-684531d7-79d4-4f47-adc8-a500296c2c7a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:06.020777 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-684531d7-79d4-4f47-adc8-a500296c2c7a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:06.021999 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-684531d7-79d4-4f47-adc8-a500296c2c7a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:06.022685 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-684531d7-79d4-4f47-adc8-a500296c2c7a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:06.171769 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-684531d7-79d4-4f47-adc8-a500296c2c7a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:06.181490 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-684531d7-79d4-4f47-adc8-a500296c2c7a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:06.183102 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-684531d7-79d4-4f47-adc8-a500296c2c7a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:06.184350 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-684531d7-79d4-4f47-adc8-a500296c2c7a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.178028 May 17 17:25:06.185075 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 208/455] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:06 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:07.202928 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4077fed4-f40d-45f4-85ae-684879fa0f14 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:07.203561 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4077fed4-f40d-45f4-85ae-684879fa0f14 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:07.209745 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4077fed4-f40d-45f4-85ae-684879fa0f14 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:07.210456 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4077fed4-f40d-45f4-85ae-684879fa0f14 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:07.211645 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4077fed4-f40d-45f4-85ae-684879fa0f14 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:07.211763 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4077fed4-f40d-45f4-85ae-684879fa0f14 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:07.351650 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4077fed4-f40d-45f4-85ae-684879fa0f14 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:07.359760 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4077fed4-f40d-45f4-85ae-684879fa0f14 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:07.361256 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4077fed4-f40d-45f4-85ae-684879fa0f14 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:07.362401 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4077fed4-f40d-45f4-85ae-684879fa0f14 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.163961 May 17 17:25:07.362952 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 248/456] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:07 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:08.380467 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-885301b7-117f-4cd2-8116-5b3f98e1a970 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:08.381078 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-885301b7-117f-4cd2-8116-5b3f98e1a970 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:08.387369 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-885301b7-117f-4cd2-8116-5b3f98e1a970 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:08.387848 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-885301b7-117f-4cd2-8116-5b3f98e1a970 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:08.388609 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-885301b7-117f-4cd2-8116-5b3f98e1a970 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:08.389043 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-885301b7-117f-4cd2-8116-5b3f98e1a970 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:08.520093 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-885301b7-117f-4cd2-8116-5b3f98e1a970 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:08.530843 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-885301b7-117f-4cd2-8116-5b3f98e1a970 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:08.533136 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-885301b7-117f-4cd2-8116-5b3f98e1a970 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:08.534321 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-885301b7-117f-4cd2-8116-5b3f98e1a970 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.157724 May 17 17:25:08.534881 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 209/457] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:08 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:09.553115 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8e70f2cf-5b72-4a6d-8347-3d85c5b17635 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:09.553740 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8e70f2cf-5b72-4a6d-8347-3d85c5b17635 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:09.561196 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8e70f2cf-5b72-4a6d-8347-3d85c5b17635 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:09.562356 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8e70f2cf-5b72-4a6d-8347-3d85c5b17635 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:09.563168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8e70f2cf-5b72-4a6d-8347-3d85c5b17635 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:09.563647 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8e70f2cf-5b72-4a6d-8347-3d85c5b17635 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:09.694675 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8e70f2cf-5b72-4a6d-8347-3d85c5b17635 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:09.703830 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8e70f2cf-5b72-4a6d-8347-3d85c5b17635 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:09.705300 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8e70f2cf-5b72-4a6d-8347-3d85c5b17635 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:09.706448 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8e70f2cf-5b72-4a6d-8347-3d85c5b17635 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.157171 May 17 17:25:09.706995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 249/458] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:09 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:10.725108 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5efc2d1c-a3fc-40c7-b008-fd446d00d7a1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:10.725713 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-5efc2d1c-a3fc-40c7-b008-fd446d00d7a1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:10.732273 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5efc2d1c-a3fc-40c7-b008-fd446d00d7a1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:10.732721 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5efc2d1c-a3fc-40c7-b008-fd446d00d7a1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:10.734154 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5efc2d1c-a3fc-40c7-b008-fd446d00d7a1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:10.734592 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5efc2d1c-a3fc-40c7-b008-fd446d00d7a1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:10.885176 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-5efc2d1c-a3fc-40c7-b008-fd446d00d7a1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:10.900000 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-5efc2d1c-a3fc-40c7-b008-fd446d00d7a1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:10.901827 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-5efc2d1c-a3fc-40c7-b008-fd446d00d7a1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:10.903579 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5efc2d1c-a3fc-40c7-b008-fd446d00d7a1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.182289 May 17 17:25:10.904310 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 210/459] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:10 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:25:11.923950 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5abbdaae-c5a2-49cb-bfdc-3b842126a76b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:11.924573 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5abbdaae-c5a2-49cb-bfdc-3b842126a76b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:11.930381 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5abbdaae-c5a2-49cb-bfdc-3b842126a76b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:11.930829 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5abbdaae-c5a2-49cb-bfdc-3b842126a76b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:11.931622 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5abbdaae-c5a2-49cb-bfdc-3b842126a76b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:11.932061 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5abbdaae-c5a2-49cb-bfdc-3b842126a76b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:12.076590 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5abbdaae-c5a2-49cb-bfdc-3b842126a76b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:12.085116 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5abbdaae-c5a2-49cb-bfdc-3b842126a76b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:12.089144 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5abbdaae-c5a2-49cb-bfdc-3b842126a76b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:12.089144 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5abbdaae-c5a2-49cb-bfdc-3b842126a76b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.168209 May 17 17:25:12.091777 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 250/460] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:11 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:13.106927 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-91bc5966-be4c-4c76-ad7b-332adaedbba8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:13.108383 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-91bc5966-be4c-4c76-ad7b-332adaedbba8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:13.116960 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-91bc5966-be4c-4c76-ad7b-332adaedbba8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:13.117826 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-91bc5966-be4c-4c76-ad7b-332adaedbba8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:13.119047 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-91bc5966-be4c-4c76-ad7b-332adaedbba8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:13.120577 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-91bc5966-be4c-4c76-ad7b-332adaedbba8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:13.278922 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-91bc5966-be4c-4c76-ad7b-332adaedbba8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:13.288410 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-91bc5966-be4c-4c76-ad7b-332adaedbba8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:13.290031 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-91bc5966-be4c-4c76-ad7b-332adaedbba8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:13.291221 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-91bc5966-be4c-4c76-ad7b-332adaedbba8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.188518 May 17 17:25:13.291883 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 211/461] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:13 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:25:14.311531 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1e180ffa-3754-4615-a47c-e61b9c5045e9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:14.312453 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1e180ffa-3754-4615-a47c-e61b9c5045e9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:14.322697 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1e180ffa-3754-4615-a47c-e61b9c5045e9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:14.323099 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1e180ffa-3754-4615-a47c-e61b9c5045e9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:14.323892 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1e180ffa-3754-4615-a47c-e61b9c5045e9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:14.324328 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1e180ffa-3754-4615-a47c-e61b9c5045e9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:14.467716 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1e180ffa-3754-4615-a47c-e61b9c5045e9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:14.478736 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1e180ffa-3754-4615-a47c-e61b9c5045e9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:14.480893 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1e180ffa-3754-4615-a47c-e61b9c5045e9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:14.482706 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1e180ffa-3754-4615-a47c-e61b9c5045e9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.176335 May 17 17:25:14.495842 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 251/462] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:14 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:15.513124 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e340694f-4a59-48de-ae05-baff66ef156b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:15.513765 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e340694f-4a59-48de-ae05-baff66ef156b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:15.522392 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e340694f-4a59-48de-ae05-baff66ef156b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:15.522841 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e340694f-4a59-48de-ae05-baff66ef156b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:15.523661 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e340694f-4a59-48de-ae05-baff66ef156b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:15.524099 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e340694f-4a59-48de-ae05-baff66ef156b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:15.659835 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e340694f-4a59-48de-ae05-baff66ef156b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:15.668607 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e340694f-4a59-48de-ae05-baff66ef156b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:15.681779 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e340694f-4a59-48de-ae05-baff66ef156b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:15.681779 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e340694f-4a59-48de-ae05-baff66ef156b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.170010 May 17 17:25:15.681779 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 212/463] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:15 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:16.699283 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7a3605a6-6828-44c7-a477-7d5c0d683517 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:16.700528 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-7a3605a6-6828-44c7-a477-7d5c0d683517 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:16.707240 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7a3605a6-6828-44c7-a477-7d5c0d683517 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:16.707726 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7a3605a6-6828-44c7-a477-7d5c0d683517 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:16.708799 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7a3605a6-6828-44c7-a477-7d5c0d683517 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:16.709317 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7a3605a6-6828-44c7-a477-7d5c0d683517 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:16.869022 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7a3605a6-6828-44c7-a477-7d5c0d683517 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:16.879210 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7a3605a6-6828-44c7-a477-7d5c0d683517 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:16.880637 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7a3605a6-6828-44c7-a477-7d5c0d683517 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:16.881785 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7a3605a6-6828-44c7-a477-7d5c0d683517 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.186412 May 17 17:25:16.882342 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 252/464] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:16 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:17.900463 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d43cad49-342c-48bc-830c-a7b287480635 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:17.901022 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d43cad49-342c-48bc-830c-a7b287480635 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:17.908178 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d43cad49-342c-48bc-830c-a7b287480635 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:17.908620 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d43cad49-342c-48bc-830c-a7b287480635 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:17.909371 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d43cad49-342c-48bc-830c-a7b287480635 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:17.909802 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d43cad49-342c-48bc-830c-a7b287480635 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:18.035985 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d43cad49-342c-48bc-830c-a7b287480635 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:18.044428 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d43cad49-342c-48bc-830c-a7b287480635 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:18.045912 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d43cad49-342c-48bc-830c-a7b287480635 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:18.047083 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d43cad49-342c-48bc-830c-a7b287480635 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.150661 May 17 17:25:18.047662 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 213/465] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:17 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:19.065497 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-00e42e9e-59eb-4100-a5e1-518aea9689c1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:19.066100 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-00e42e9e-59eb-4100-a5e1-518aea9689c1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:19.072013 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-00e42e9e-59eb-4100-a5e1-518aea9689c1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:19.072454 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-00e42e9e-59eb-4100-a5e1-518aea9689c1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:19.073210 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-00e42e9e-59eb-4100-a5e1-518aea9689c1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:19.073638 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-00e42e9e-59eb-4100-a5e1-518aea9689c1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:19.196335 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-00e42e9e-59eb-4100-a5e1-518aea9689c1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:19.204846 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-00e42e9e-59eb-4100-a5e1-518aea9689c1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:19.206321 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-00e42e9e-59eb-4100-a5e1-518aea9689c1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:19.207454 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-00e42e9e-59eb-4100-a5e1-518aea9689c1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.146386 May 17 17:25:19.208043 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 253/466] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:19 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:20.225606 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-914e301e-ed55-498b-b539-56f9d444d241 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:20.226220 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-914e301e-ed55-498b-b539-56f9d444d241 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:20.232583 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-914e301e-ed55-498b-b539-56f9d444d241 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:20.233006 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-914e301e-ed55-498b-b539-56f9d444d241 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:20.233765 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-914e301e-ed55-498b-b539-56f9d444d241 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:20.234841 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-914e301e-ed55-498b-b539-56f9d444d241 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:20.361641 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-914e301e-ed55-498b-b539-56f9d444d241 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:20.369929 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-914e301e-ed55-498b-b539-56f9d444d241 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:20.371422 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-914e301e-ed55-498b-b539-56f9d444d241 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:20.372596 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-914e301e-ed55-498b-b539-56f9d444d241 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.150931 May 17 17:25:20.373150 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 214/467] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:20 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:21.391385 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-26bb915e-cc3e-4f59-a666-b7b184d68a62 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:21.391999 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-26bb915e-cc3e-4f59-a666-b7b184d68a62 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:21.397918 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-26bb915e-cc3e-4f59-a666-b7b184d68a62 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:21.398363 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-26bb915e-cc3e-4f59-a666-b7b184d68a62 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:21.399120 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-26bb915e-cc3e-4f59-a666-b7b184d68a62 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:21.399576 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-26bb915e-cc3e-4f59-a666-b7b184d68a62 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:21.530810 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-26bb915e-cc3e-4f59-a666-b7b184d68a62 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:21.540067 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-26bb915e-cc3e-4f59-a666-b7b184d68a62 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:21.541590 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-26bb915e-cc3e-4f59-a666-b7b184d68a62 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:21.542725 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-26bb915e-cc3e-4f59-a666-b7b184d68a62 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.155765 May 17 17:25:21.543272 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 254/468] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:21 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:22.566624 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-14c0c14e-353c-4539-bdf3-fa9eb1a7ee59 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:22.567294 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-14c0c14e-353c-4539-bdf3-fa9eb1a7ee59 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:22.573814 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-14c0c14e-353c-4539-bdf3-fa9eb1a7ee59 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:22.574262 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-14c0c14e-353c-4539-bdf3-fa9eb1a7ee59 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:22.575030 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-14c0c14e-353c-4539-bdf3-fa9eb1a7ee59 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:22.575460 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-14c0c14e-353c-4539-bdf3-fa9eb1a7ee59 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:22.702968 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-14c0c14e-353c-4539-bdf3-fa9eb1a7ee59 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:22.711110 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-14c0c14e-353c-4539-bdf3-fa9eb1a7ee59 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:22.712615 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-14c0c14e-353c-4539-bdf3-fa9eb1a7ee59 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:22.713759 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-14c0c14e-353c-4539-bdf3-fa9eb1a7ee59 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.150973 May 17 17:25:22.714312 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 215/469] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:22 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:23.732276 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e18c699a-374c-4348-a569-ab6a282ded33 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:23.733007 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e18c699a-374c-4348-a569-ab6a282ded33 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:23.742456 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e18c699a-374c-4348-a569-ab6a282ded33 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:23.742456 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e18c699a-374c-4348-a569-ab6a282ded33 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:23.742456 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e18c699a-374c-4348-a569-ab6a282ded33 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:23.742456 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e18c699a-374c-4348-a569-ab6a282ded33 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:23.866935 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e18c699a-374c-4348-a569-ab6a282ded33 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:23.875731 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e18c699a-374c-4348-a569-ab6a282ded33 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:23.877209 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e18c699a-374c-4348-a569-ab6a282ded33 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:23.878335 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e18c699a-374c-4348-a569-ab6a282ded33 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.149879 May 17 17:25:23.878886 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 255/470] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:23 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:24.895988 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-9b333c64-c056-4b59-8812-088f88effd50 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:24.896602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-9b333c64-c056-4b59-8812-088f88effd50 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:24.902373 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9b333c64-c056-4b59-8812-088f88effd50 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:24.902826 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9b333c64-c056-4b59-8812-088f88effd50 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:24.903622 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9b333c64-c056-4b59-8812-088f88effd50 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:24.904060 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9b333c64-c056-4b59-8812-088f88effd50 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:25.035962 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-9b333c64-c056-4b59-8812-088f88effd50 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:25.044297 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-9b333c64-c056-4b59-8812-088f88effd50 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:25.045772 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-9b333c64-c056-4b59-8812-088f88effd50 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:25.047398 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-9b333c64-c056-4b59-8812-088f88effd50 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.155387 May 17 17:25:25.047973 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 216/471] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:24 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:26.065796 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7395c6c0-02c5-418d-a9ff-d4b56a3abd9e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:26.066363 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-7395c6c0-02c5-418d-a9ff-d4b56a3abd9e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:26.072351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7395c6c0-02c5-418d-a9ff-d4b56a3abd9e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:26.072800 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7395c6c0-02c5-418d-a9ff-d4b56a3abd9e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:26.073565 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7395c6c0-02c5-418d-a9ff-d4b56a3abd9e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:26.074000 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7395c6c0-02c5-418d-a9ff-d4b56a3abd9e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:26.199212 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7395c6c0-02c5-418d-a9ff-d4b56a3abd9e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:26.207964 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7395c6c0-02c5-418d-a9ff-d4b56a3abd9e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:26.209466 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7395c6c0-02c5-418d-a9ff-d4b56a3abd9e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:26.210600 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7395c6c0-02c5-418d-a9ff-d4b56a3abd9e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.148830 May 17 17:25:26.211149 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 256/472] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:26 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:27.228683 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-28b64f9f-3200-46bc-b16d-991759be2e60 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:27.229258 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-28b64f9f-3200-46bc-b16d-991759be2e60 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:27.236141 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-28b64f9f-3200-46bc-b16d-991759be2e60 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:27.236596 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-28b64f9f-3200-46bc-b16d-991759be2e60 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:27.237385 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-28b64f9f-3200-46bc-b16d-991759be2e60 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:27.237818 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-28b64f9f-3200-46bc-b16d-991759be2e60 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:27.362392 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-28b64f9f-3200-46bc-b16d-991759be2e60 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:27.370382 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-28b64f9f-3200-46bc-b16d-991759be2e60 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:27.371958 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-28b64f9f-3200-46bc-b16d-991759be2e60 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:27.373099 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-28b64f9f-3200-46bc-b16d-991759be2e60 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.148351 May 17 17:25:27.373649 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 217/473] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:27 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:25:28.391413 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e7a36ae9-86a2-44a0-9f7d-efae1202701f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:28.392009 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e7a36ae9-86a2-44a0-9f7d-efae1202701f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:28.397909 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e7a36ae9-86a2-44a0-9f7d-efae1202701f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:28.398359 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e7a36ae9-86a2-44a0-9f7d-efae1202701f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:28.399124 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e7a36ae9-86a2-44a0-9f7d-efae1202701f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:28.399583 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e7a36ae9-86a2-44a0-9f7d-efae1202701f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:28.527666 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e7a36ae9-86a2-44a0-9f7d-efae1202701f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:28.536586 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e7a36ae9-86a2-44a0-9f7d-efae1202701f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:28.538084 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e7a36ae9-86a2-44a0-9f7d-efae1202701f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:28.539233 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e7a36ae9-86a2-44a0-9f7d-efae1202701f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.151772 May 17 17:25:28.539827 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 257/474] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:28 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:29.558113 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-67f013cb-87b2-4201-a855-8dfdceaf42b7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:29.558754 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-67f013cb-87b2-4201-a855-8dfdceaf42b7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:29.565720 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-67f013cb-87b2-4201-a855-8dfdceaf42b7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:29.566168 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-67f013cb-87b2-4201-a855-8dfdceaf42b7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:29.566953 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-67f013cb-87b2-4201-a855-8dfdceaf42b7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:29.567392 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-67f013cb-87b2-4201-a855-8dfdceaf42b7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:29.692245 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-67f013cb-87b2-4201-a855-8dfdceaf42b7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:29.700313 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-67f013cb-87b2-4201-a855-8dfdceaf42b7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:29.701839 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-67f013cb-87b2-4201-a855-8dfdceaf42b7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:29.703012 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-67f013cb-87b2-4201-a855-8dfdceaf42b7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.148764 May 17 17:25:29.703585 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 218/475] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:29 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:30.721828 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-185cc2f5-5f62-46e7-8527-e29550c57a44 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:30.722428 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-185cc2f5-5f62-46e7-8527-e29550c57a44 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:30.728302 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-185cc2f5-5f62-46e7-8527-e29550c57a44 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:30.728747 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-185cc2f5-5f62-46e7-8527-e29550c57a44 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:30.729502 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-185cc2f5-5f62-46e7-8527-e29550c57a44 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:30.729930 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-185cc2f5-5f62-46e7-8527-e29550c57a44 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:30.854216 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-185cc2f5-5f62-46e7-8527-e29550c57a44 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:30.862920 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-185cc2f5-5f62-46e7-8527-e29550c57a44 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:30.864424 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-185cc2f5-5f62-46e7-8527-e29550c57a44 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:30.865556 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-185cc2f5-5f62-46e7-8527-e29550c57a44 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.148088 May 17 17:25:30.866106 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 258/476] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:30 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:31.883183 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-2e7e3c5f-3422-45ef-bad0-c8450dc23595 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:31.883765 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-2e7e3c5f-3422-45ef-bad0-c8450dc23595 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:31.890138 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2e7e3c5f-3422-45ef-bad0-c8450dc23595 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:31.890589 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2e7e3c5f-3422-45ef-bad0-c8450dc23595 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:31.891353 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2e7e3c5f-3422-45ef-bad0-c8450dc23595 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:31.891842 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2e7e3c5f-3422-45ef-bad0-c8450dc23595 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:32.016311 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2e7e3c5f-3422-45ef-bad0-c8450dc23595 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:32.024982 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2e7e3c5f-3422-45ef-bad0-c8450dc23595 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:32.026502 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2e7e3c5f-3422-45ef-bad0-c8450dc23595 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:32.027651 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-2e7e3c5f-3422-45ef-bad0-c8450dc23595 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.148416 May 17 17:25:32.028214 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 219/477] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:31 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:32.151355 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-224d4431-998d-4071-8ef1-402d1b71d619 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:32.151904 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-224d4431-998d-4071-8ef1-402d1b71d619 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:32.158091 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-224d4431-998d-4071-8ef1-402d1b71d619 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:32.158532 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-224d4431-998d-4071-8ef1-402d1b71d619 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:32.159288 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-224d4431-998d-4071-8ef1-402d1b71d619 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:32.159764 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-224d4431-998d-4071-8ef1-402d1b71d619 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:32.278419 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-224d4431-998d-4071-8ef1-402d1b71d619 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lazy-loading 'services' on Instance uuid 3a87018c-9e2f-4322-8472-dbe43085332f {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:25:32.514162 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-224d4431-998d-4071-8ef1-402d1b71d619 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f/os-volume_attachments/72582672-4a30-47a4-a7af-d3c40d659794" status: 202 len: 0 microversion: 2.1 time: 0.366791 May 17 17:25:32.514809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 259/478] 10.222.0.88 () {58 vars in 1415 bytes} [Tue May 17 17:25:32 2022] DELETE /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f/os-volume_attachments/72582672-4a30-47a4-a7af-d3c40d659794 => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:25:33.046483 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-439ecec6-33a3-4756-9e3e-ddc088836117 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:33.047093 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-439ecec6-33a3-4756-9e3e-ddc088836117 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:33.054082 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-439ecec6-33a3-4756-9e3e-ddc088836117 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:33.054528 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-439ecec6-33a3-4756-9e3e-ddc088836117 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:33.055288 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-439ecec6-33a3-4756-9e3e-ddc088836117 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:33.055747 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-439ecec6-33a3-4756-9e3e-ddc088836117 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:33.180988 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-439ecec6-33a3-4756-9e3e-ddc088836117 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:33.189189 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-439ecec6-33a3-4756-9e3e-ddc088836117 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:33.190692 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-439ecec6-33a3-4756-9e3e-ddc088836117 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:33.191872 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-439ecec6-33a3-4756-9e3e-ddc088836117 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.149237 May 17 17:25:33.192428 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 220/479] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:33 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:34.210140 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5a5d8273-669a-4734-891a-d8d4cb892091 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:34.210854 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5a5d8273-669a-4734-891a-d8d4cb892091 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:34.216887 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5a5d8273-669a-4734-891a-d8d4cb892091 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:34.217392 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5a5d8273-669a-4734-891a-d8d4cb892091 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:34.233131 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5a5d8273-669a-4734-891a-d8d4cb892091 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:34.233131 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5a5d8273-669a-4734-891a-d8d4cb892091 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:34.345725 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5a5d8273-669a-4734-891a-d8d4cb892091 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:34.354530 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5a5d8273-669a-4734-891a-d8d4cb892091 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:34.356048 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5a5d8273-669a-4734-891a-d8d4cb892091 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:34.357200 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5a5d8273-669a-4734-891a-d8d4cb892091 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.151344 May 17 17:25:34.357758 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 260/480] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:34 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:35.376272 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f03db882-50dc-42de-8967-415b36326bb4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:35.376879 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f03db882-50dc-42de-8967-415b36326bb4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:35.383163 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f03db882-50dc-42de-8967-415b36326bb4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:35.383672 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f03db882-50dc-42de-8967-415b36326bb4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:35.384486 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f03db882-50dc-42de-8967-415b36326bb4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:35.384874 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f03db882-50dc-42de-8967-415b36326bb4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:35.508031 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f03db882-50dc-42de-8967-415b36326bb4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:35.516189 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f03db882-50dc-42de-8967-415b36326bb4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:35.517681 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f03db882-50dc-42de-8967-415b36326bb4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:35.519323 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f03db882-50dc-42de-8967-415b36326bb4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.146457 May 17 17:25:35.519924 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 221/481] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:35 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:36.537569 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e9f0f7cb-256c-4de9-bd9f-8f5c5c8e4b47 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:36.538173 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e9f0f7cb-256c-4de9-bd9f-8f5c5c8e4b47 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:36.543939 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e9f0f7cb-256c-4de9-bd9f-8f5c5c8e4b47 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:36.544383 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e9f0f7cb-256c-4de9-bd9f-8f5c5c8e4b47 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:36.545134 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e9f0f7cb-256c-4de9-bd9f-8f5c5c8e4b47 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:36.545562 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e9f0f7cb-256c-4de9-bd9f-8f5c5c8e4b47 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:36.677162 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e9f0f7cb-256c-4de9-bd9f-8f5c5c8e4b47 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:36.685299 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e9f0f7cb-256c-4de9-bd9f-8f5c5c8e4b47 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:36.686774 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e9f0f7cb-256c-4de9-bd9f-8f5c5c8e4b47 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:36.687942 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e9f0f7cb-256c-4de9-bd9f-8f5c5c8e4b47 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.154163 May 17 17:25:36.688497 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 261/482] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:36 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:37.705988 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3a6bc2be-068e-412e-ae59-cc864e8a31f5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:37.707316 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3a6bc2be-068e-412e-ae59-cc864e8a31f5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:37.713722 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3a6bc2be-068e-412e-ae59-cc864e8a31f5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:37.714167 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3a6bc2be-068e-412e-ae59-cc864e8a31f5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:37.714929 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3a6bc2be-068e-412e-ae59-cc864e8a31f5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:37.715362 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3a6bc2be-068e-412e-ae59-cc864e8a31f5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:37.843045 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3a6bc2be-068e-412e-ae59-cc864e8a31f5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:37.852286 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3a6bc2be-068e-412e-ae59-cc864e8a31f5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:37.853781 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3a6bc2be-068e-412e-ae59-cc864e8a31f5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:37.854927 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3a6bc2be-068e-412e-ae59-cc864e8a31f5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.152987 May 17 17:25:37.855484 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 222/483] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:37 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:38.873709 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6ef1d947-72ec-42e3-8eee-1e838801a0ff tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:38.874255 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6ef1d947-72ec-42e3-8eee-1e838801a0ff tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:38.880889 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6ef1d947-72ec-42e3-8eee-1e838801a0ff tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:38.881342 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6ef1d947-72ec-42e3-8eee-1e838801a0ff tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:38.882111 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6ef1d947-72ec-42e3-8eee-1e838801a0ff tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:38.882550 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6ef1d947-72ec-42e3-8eee-1e838801a0ff tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:39.010518 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6ef1d947-72ec-42e3-8eee-1e838801a0ff tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:39.019725 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6ef1d947-72ec-42e3-8eee-1e838801a0ff tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:39.021253 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6ef1d947-72ec-42e3-8eee-1e838801a0ff tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:39.022396 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6ef1d947-72ec-42e3-8eee-1e838801a0ff tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.152567 May 17 17:25:39.022948 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 262/484] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:38 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:40.041413 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-79fad35a-50ef-49c4-b224-57add0ce715a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:40.042013 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-79fad35a-50ef-49c4-b224-57add0ce715a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:40.048345 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-79fad35a-50ef-49c4-b224-57add0ce715a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:40.048792 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-79fad35a-50ef-49c4-b224-57add0ce715a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:40.049542 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-79fad35a-50ef-49c4-b224-57add0ce715a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:40.049981 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-79fad35a-50ef-49c4-b224-57add0ce715a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:40.172483 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-79fad35a-50ef-49c4-b224-57add0ce715a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:40.180593 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-79fad35a-50ef-49c4-b224-57add0ce715a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:40.182086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-79fad35a-50ef-49c4-b224-57add0ce715a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:40.183231 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-79fad35a-50ef-49c4-b224-57add0ce715a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.145663 May 17 17:25:40.183826 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 223/485] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:40 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:41.201229 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b2901f35-f0e3-456c-b379-b6afa2a7f5fb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:41.201777 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b2901f35-f0e3-456c-b379-b6afa2a7f5fb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:41.208467 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b2901f35-f0e3-456c-b379-b6afa2a7f5fb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:41.208990 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b2901f35-f0e3-456c-b379-b6afa2a7f5fb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:41.209750 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b2901f35-f0e3-456c-b379-b6afa2a7f5fb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:41.210282 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b2901f35-f0e3-456c-b379-b6afa2a7f5fb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:41.335846 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b2901f35-f0e3-456c-b379-b6afa2a7f5fb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:41.344039 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b2901f35-f0e3-456c-b379-b6afa2a7f5fb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:41.345516 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b2901f35-f0e3-456c-b379-b6afa2a7f5fb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:41.346640 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b2901f35-f0e3-456c-b379-b6afa2a7f5fb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.149276 May 17 17:25:41.347829 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 263/486] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:41 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:42.144100 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-47659aa0-68a3-4bd4-939f-abd0c1d6057a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ea9b902-e617-4332-92c7-65b139298d6a"}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:25:42.145838 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-47659aa0-68a3-4bd4-939f-abd0c1d6057a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:42.152170 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-47659aa0-68a3-4bd4-939f-abd0c1d6057a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:42.152619 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-47659aa0-68a3-4bd4-939f-abd0c1d6057a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:42.153384 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-47659aa0-68a3-4bd4-939f-abd0c1d6057a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:42.153818 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-47659aa0-68a3-4bd4-939f-abd0c1d6057a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:42.365801 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0a618da1-84be-48c1-b35c-f4b1d942ae65 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:42.366712 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0a618da1-84be-48c1-b35c-f4b1d942ae65 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:42.373835 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0a618da1-84be-48c1-b35c-f4b1d942ae65 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:42.374384 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0a618da1-84be-48c1-b35c-f4b1d942ae65 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:42.375353 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0a618da1-84be-48c1-b35c-f4b1d942ae65 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:42.375998 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0a618da1-84be-48c1-b35c-f4b1d942ae65 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:42.512007 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0a618da1-84be-48c1-b35c-f4b1d942ae65 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:42.520423 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0a618da1-84be-48c1-b35c-f4b1d942ae65 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:42.521902 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0a618da1-84be-48c1-b35c-f4b1d942ae65 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:42.523029 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0a618da1-84be-48c1-b35c-f4b1d942ae65 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.161807 May 17 17:25:42.523625 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 264/487] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:42 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:25:43.541606 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ceb7ad48-668f-49ff-ab58-d1ea53c517e6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:43.542252 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ceb7ad48-668f-49ff-ab58-d1ea53c517e6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:43.548136 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ceb7ad48-668f-49ff-ab58-d1ea53c517e6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:43.548584 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ceb7ad48-668f-49ff-ab58-d1ea53c517e6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:43.549347 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ceb7ad48-668f-49ff-ab58-d1ea53c517e6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:43.549782 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ceb7ad48-668f-49ff-ab58-d1ea53c517e6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:43.678709 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ceb7ad48-668f-49ff-ab58-d1ea53c517e6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:43.687122 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ceb7ad48-668f-49ff-ab58-d1ea53c517e6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:43.688726 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ceb7ad48-668f-49ff-ab58-d1ea53c517e6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:43.689940 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ceb7ad48-668f-49ff-ab58-d1ea53c517e6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.152377 May 17 17:25:43.690748 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 265/488] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:43 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:25:44.709002 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e664686b-d457-45d7-97ab-7a682270ccad tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:44.709623 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e664686b-d457-45d7-97ab-7a682270ccad tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:44.715596 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e664686b-d457-45d7-97ab-7a682270ccad tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:44.716049 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e664686b-d457-45d7-97ab-7a682270ccad tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:44.716813 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e664686b-d457-45d7-97ab-7a682270ccad tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:44.717245 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e664686b-d457-45d7-97ab-7a682270ccad tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:44.844254 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e664686b-d457-45d7-97ab-7a682270ccad tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:44.852297 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e664686b-d457-45d7-97ab-7a682270ccad tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:44.853776 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e664686b-d457-45d7-97ab-7a682270ccad tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:44.854904 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e664686b-d457-45d7-97ab-7a682270ccad tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.150269 May 17 17:25:44.855458 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 266/489] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:44 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:25:45.872822 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6442ff00-4f51-4b1a-937e-cf44b4b7a8cf tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:45.873424 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6442ff00-4f51-4b1a-937e-cf44b4b7a8cf tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:45.879280 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6442ff00-4f51-4b1a-937e-cf44b4b7a8cf tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:45.879801 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6442ff00-4f51-4b1a-937e-cf44b4b7a8cf tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:45.880711 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6442ff00-4f51-4b1a-937e-cf44b4b7a8cf tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:45.881143 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6442ff00-4f51-4b1a-937e-cf44b4b7a8cf tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:46.003250 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6442ff00-4f51-4b1a-937e-cf44b4b7a8cf tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:46.011305 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6442ff00-4f51-4b1a-937e-cf44b4b7a8cf tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:46.012815 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6442ff00-4f51-4b1a-937e-cf44b4b7a8cf tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:46.013945 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6442ff00-4f51-4b1a-937e-cf44b4b7a8cf tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.144959 May 17 17:25:46.014497 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 267/490] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:45 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:25:46.453313 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-a3ced666-3b70-410f-84d8-d35013cd2004 req-599f032e-5f3e-4d7b-bd7b-7ce719986164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44", "name": "network-vif-plugged", "status": "completed", "tag": "88984695-6cd9-4b4c-b02c-9f8d26d785d7"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:25:46.462070 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-a3ced666-3b70-410f-84d8-d35013cd2004 req-599f032e-5f3e-4d7b-bd7b-7ce719986164 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:46.462509 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-a3ced666-3b70-410f-84d8-d35013cd2004 req-599f032e-5f3e-4d7b-bd7b-7ce719986164 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:46.473990 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-a3ced666-3b70-410f-84d8-d35013cd2004 req-599f032e-5f3e-4d7b-bd7b-7ce719986164 service nova] Creating event network-vif-plugged:88984695-6cd9-4b4c-b02c-9f8d26d785d7 for instance bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 on hv-cinder-84214 May 17 17:25:46.478946 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-a3ced666-3b70-410f-84d8-d35013cd2004 req-599f032e-5f3e-4d7b-bd7b-7ce719986164 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029636 May 17 17:25:46.479539 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 268/491] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:25:47.033597 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-da5711ce-9ac9-4104-a706-c016af2559c5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:47.039310 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-da5711ce-9ac9-4104-a706-c016af2559c5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:47.041616 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-da5711ce-9ac9-4104-a706-c016af2559c5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:47.042019 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-da5711ce-9ac9-4104-a706-c016af2559c5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:47.042889 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-da5711ce-9ac9-4104-a706-c016af2559c5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:47.043355 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-da5711ce-9ac9-4104-a706-c016af2559c5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:47.174207 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-da5711ce-9ac9-4104-a706-c016af2559c5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:47.182671 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-da5711ce-9ac9-4104-a706-c016af2559c5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:47.184250 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-da5711ce-9ac9-4104-a706-c016af2559c5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:47.185461 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-da5711ce-9ac9-4104-a706-c016af2559c5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.156729 May 17 17:25:47.186007 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 269/492] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:47 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:25:48.204733 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-96248fd4-a324-4917-8fdb-a0357a81e857 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:48.205326 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-96248fd4-a324-4917-8fdb-a0357a81e857 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:48.211687 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-96248fd4-a324-4917-8fdb-a0357a81e857 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:48.212140 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-96248fd4-a324-4917-8fdb-a0357a81e857 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:48.212902 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-96248fd4-a324-4917-8fdb-a0357a81e857 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:48.213336 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-96248fd4-a324-4917-8fdb-a0357a81e857 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:48.352525 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-96248fd4-a324-4917-8fdb-a0357a81e857 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:48.360864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-96248fd4-a324-4917-8fdb-a0357a81e857 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:48.362346 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-96248fd4-a324-4917-8fdb-a0357a81e857 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:48.363493 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-96248fd4-a324-4917-8fdb-a0357a81e857 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.162853 May 17 17:25:48.364093 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 270/493] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:48 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:25:49.382018 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a5187ef4-49b6-439d-bcc2-1ffa7abece85 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:49.382635 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a5187ef4-49b6-439d-bcc2-1ffa7abece85 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:49.388492 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a5187ef4-49b6-439d-bcc2-1ffa7abece85 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:49.388954 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a5187ef4-49b6-439d-bcc2-1ffa7abece85 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:49.389705 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a5187ef4-49b6-439d-bcc2-1ffa7abece85 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:49.390136 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a5187ef4-49b6-439d-bcc2-1ffa7abece85 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:49.740524 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a5187ef4-49b6-439d-bcc2-1ffa7abece85 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:49.748741 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a5187ef4-49b6-439d-bcc2-1ffa7abece85 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:49.750198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a5187ef4-49b6-439d-bcc2-1ffa7abece85 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:49.751317 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a5187ef4-49b6-439d-bcc2-1ffa7abece85 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.373514 May 17 17:25:49.751956 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 271/494] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:49 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:25:50.769995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c0f0c22f-8ec5-4b2e-a63d-74cbaead77bd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:50.770674 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c0f0c22f-8ec5-4b2e-a63d-74cbaead77bd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:50.777092 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c0f0c22f-8ec5-4b2e-a63d-74cbaead77bd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:50.777537 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c0f0c22f-8ec5-4b2e-a63d-74cbaead77bd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:50.778307 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c0f0c22f-8ec5-4b2e-a63d-74cbaead77bd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:50.778772 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c0f0c22f-8ec5-4b2e-a63d-74cbaead77bd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:50.988322 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c0f0c22f-8ec5-4b2e-a63d-74cbaead77bd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:50.996829 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c0f0c22f-8ec5-4b2e-a63d-74cbaead77bd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:50.998363 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c0f0c22f-8ec5-4b2e-a63d-74cbaead77bd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:50.999504 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c0f0c22f-8ec5-4b2e-a63d-74cbaead77bd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.233392 May 17 17:25:51.000408 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 272/495] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:50 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:52.018740 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5cdf42af-990f-4cc7-9efc-32c8c8022c6a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:52.019363 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5cdf42af-990f-4cc7-9efc-32c8c8022c6a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:52.026691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5cdf42af-990f-4cc7-9efc-32c8c8022c6a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:52.026691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5cdf42af-990f-4cc7-9efc-32c8c8022c6a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:52.027683 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5cdf42af-990f-4cc7-9efc-32c8c8022c6a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:52.028116 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5cdf42af-990f-4cc7-9efc-32c8c8022c6a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:52.159846 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5cdf42af-990f-4cc7-9efc-32c8c8022c6a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:52.172401 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5cdf42af-990f-4cc7-9efc-32c8c8022c6a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:52.174097 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5cdf42af-990f-4cc7-9efc-32c8c8022c6a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:52.177015 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5cdf42af-990f-4cc7-9efc-32c8c8022c6a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.162677 May 17 17:25:52.188687 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 273/496] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:52 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:25:53.196565 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f9973260-815b-4252-abc8-455f0cd29e5b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:53.197167 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f9973260-815b-4252-abc8-455f0cd29e5b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:53.203023 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f9973260-815b-4252-abc8-455f0cd29e5b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:53.203466 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f9973260-815b-4252-abc8-455f0cd29e5b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:53.209089 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f9973260-815b-4252-abc8-455f0cd29e5b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:53.209089 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f9973260-815b-4252-abc8-455f0cd29e5b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:53.454856 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f9973260-815b-4252-abc8-455f0cd29e5b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:53.465422 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f9973260-815b-4252-abc8-455f0cd29e5b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:53.467355 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f9973260-815b-4252-abc8-455f0cd29e5b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:53.468728 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f9973260-815b-4252-abc8-455f0cd29e5b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.276629 May 17 17:25:53.469281 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 274/497] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:53 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:25:54.487097 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a02cb0e3-5efe-4b28-8de7-5101b31ea6b3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:54.488423 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a02cb0e3-5efe-4b28-8de7-5101b31ea6b3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:54.494523 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a02cb0e3-5efe-4b28-8de7-5101b31ea6b3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:54.494967 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a02cb0e3-5efe-4b28-8de7-5101b31ea6b3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:54.495768 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a02cb0e3-5efe-4b28-8de7-5101b31ea6b3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:54.496204 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a02cb0e3-5efe-4b28-8de7-5101b31ea6b3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:54.631751 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a02cb0e3-5efe-4b28-8de7-5101b31ea6b3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:54.640672 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a02cb0e3-5efe-4b28-8de7-5101b31ea6b3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:54.642499 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a02cb0e3-5efe-4b28-8de7-5101b31ea6b3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:54.644363 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a02cb0e3-5efe-4b28-8de7-5101b31ea6b3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.161384 May 17 17:25:54.644894 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 275/498] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:54 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:25:55.663149 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1bb9eb65-e58a-4278-9035-bb1738e60cba tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:55.664498 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1bb9eb65-e58a-4278-9035-bb1738e60cba tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:55.670908 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1bb9eb65-e58a-4278-9035-bb1738e60cba tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:55.671621 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1bb9eb65-e58a-4278-9035-bb1738e60cba tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:55.672595 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1bb9eb65-e58a-4278-9035-bb1738e60cba tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:55.673190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1bb9eb65-e58a-4278-9035-bb1738e60cba tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:56.070799 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1bb9eb65-e58a-4278-9035-bb1738e60cba tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:56.079940 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1bb9eb65-e58a-4278-9035-bb1738e60cba tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:56.081643 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1bb9eb65-e58a-4278-9035-bb1738e60cba tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:56.083009 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1bb9eb65-e58a-4278-9035-bb1738e60cba tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.424376 May 17 17:25:56.084412 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 276/499] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:55 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:25:57.100783 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7a25448f-4d9f-4c39-9d62-9c4ad0cd5670 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:57.101541 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-7a25448f-4d9f-4c39-9d62-9c4ad0cd5670 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:57.110326 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7a25448f-4d9f-4c39-9d62-9c4ad0cd5670 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:57.110776 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7a25448f-4d9f-4c39-9d62-9c4ad0cd5670 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:57.111571 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7a25448f-4d9f-4c39-9d62-9c4ad0cd5670 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:57.112187 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7a25448f-4d9f-4c39-9d62-9c4ad0cd5670 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:57.372371 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7a25448f-4d9f-4c39-9d62-9c4ad0cd5670 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:57.441457 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7a25448f-4d9f-4c39-9d62-9c4ad0cd5670 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:57.443699 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7a25448f-4d9f-4c39-9d62-9c4ad0cd5670 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:57.444912 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7a25448f-4d9f-4c39-9d62-9c4ad0cd5670 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.347999 May 17 17:25:57.457946 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 277/500] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:57 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:57.464196 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3fb6e35f-66f1-4bdf-92bf-e523f86fc253 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:57.464697 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3fb6e35f-66f1-4bdf-92bf-e523f86fc253 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:57.473954 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3fb6e35f-66f1-4bdf-92bf-e523f86fc253 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:57.474919 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3fb6e35f-66f1-4bdf-92bf-e523f86fc253 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:57.475739 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3fb6e35f-66f1-4bdf-92bf-e523f86fc253 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:57.476183 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3fb6e35f-66f1-4bdf-92bf-e523f86fc253 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:57.518115 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3fb6e35f-66f1-4bdf-92bf-e523f86fc253 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Going to try to terminate instance {{(pid=117612) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:25:57.949681 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3fb6e35f-66f1-4bdf-92bf-e523f86fc253 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "DELETE /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37" status: 204 len: 0 microversion: 2.1 time: 0.489637 May 17 17:25:57.953401 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 278/501] 10.222.0.88 () {58 vars in 1238 bytes} [Tue May 17 17:25:57 2022] DELETE /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:25:57.960512 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-db37578f-6214-4720-a112-329f18d1e3bd req-8d527996-7ffc-4bdb-b993-01d950c1e56e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bf11f0d-a455-430a-b320-5163e1b98b37", "tag": "78dcbc08-7968-4aa1-95fa-f2034bb56aae"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:25:57.977766 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-db37578f-6214-4720-a112-329f18d1e3bd req-8d527996-7ffc-4bdb-b993-01d950c1e56e service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:57.982291 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-db37578f-6214-4720-a112-329f18d1e3bd req-8d527996-7ffc-4bdb-b993-01d950c1e56e service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:58.000352 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-db37578f-6214-4720-a112-329f18d1e3bd req-8d527996-7ffc-4bdb-b993-01d950c1e56e service nova] Creating event network-changed:78dcbc08-7968-4aa1-95fa-f2034bb56aae for instance 9bf11f0d-a455-430a-b320-5163e1b98b37 on hv-cinder-84214 May 17 17:25:58.006718 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-db37578f-6214-4720-a112-329f18d1e3bd req-8d527996-7ffc-4bdb-b993-01d950c1e56e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054614 May 17 17:25:58.007540 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 279/502] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:25:58.014769 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e6b77364-d3ab-43db-8bf9-981bf964e36d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:58.014769 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e6b77364-d3ab-43db-8bf9-981bf964e36d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:58.022153 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e6b77364-d3ab-43db-8bf9-981bf964e36d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:58.022619 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e6b77364-d3ab-43db-8bf9-981bf964e36d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:58.023411 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e6b77364-d3ab-43db-8bf9-981bf964e36d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:58.026382 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e6b77364-d3ab-43db-8bf9-981bf964e36d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:58.325683 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e6b77364-d3ab-43db-8bf9-981bf964e36d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d565f5725984bf6908fd35b557f8736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e4a7b9a0a74c2788facfa3035fc8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:58.333455 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e6b77364-d3ab-43db-8bf9-981bf964e36d tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37" status: 200 len: 1566 microversion: 2.1 time: 0.324643 May 17 17:25:58.344414 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 280/503] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:25:58 2022] GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 => generated 1566 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:25:58.447803 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-47659aa0-68a3-4bd4-939f-abd0c1d6057a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "POST /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 16.307343 May 17 17:25:58.453910 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 224/504] 10.222.0.88 () {60 vars in 1322 bytes} [Tue May 17 17:25:42 2022] POST /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0/os-volume_attachments => generated 194 bytes in 16314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:25:58.469449 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f0fc148b-4e9d-4b97-98da-f8c60f5998bf tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:58.470268 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f0fc148b-4e9d-4b97-98da-f8c60f5998bf tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:58.499111 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f0fc148b-4e9d-4b97-98da-f8c60f5998bf tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:58.506548 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f0fc148b-4e9d-4b97-98da-f8c60f5998bf tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:58.507614 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f0fc148b-4e9d-4b97-98da-f8c60f5998bf tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:58.508012 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f0fc148b-4e9d-4b97-98da-f8c60f5998bf tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:58.792725 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f0fc148b-4e9d-4b97-98da-f8c60f5998bf tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:58.802379 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f0fc148b-4e9d-4b97-98da-f8c60f5998bf tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:58.804135 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f0fc148b-4e9d-4b97-98da-f8c60f5998bf tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:58.805485 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f0fc148b-4e9d-4b97-98da-f8c60f5998bf tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.346497 May 17 17:25:58.806152 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 281/505] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:58 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:25:59.354497 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ab92d092-3eb8-4c62-ae76-c64d2ed3b272 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:59.356321 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ab92d092-3eb8-4c62-ae76-c64d2ed3b272 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:59.363669 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ab92d092-3eb8-4c62-ae76-c64d2ed3b272 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:59.364555 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ab92d092-3eb8-4c62-ae76-c64d2ed3b272 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:59.365505 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ab92d092-3eb8-4c62-ae76-c64d2ed3b272 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:59.370149 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ab92d092-3eb8-4c62-ae76-c64d2ed3b272 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:59.686963 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ab92d092-3eb8-4c62-ae76-c64d2ed3b272 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d565f5725984bf6908fd35b557f8736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e4a7b9a0a74c2788facfa3035fc8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:25:59.696406 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ab92d092-3eb8-4c62-ae76-c64d2ed3b272 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37" status: 200 len: 1566 microversion: 2.1 time: 0.347042 May 17 17:25:59.703943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 225/506] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:25:59 2022] GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 => generated 1566 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:25:59.824149 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-253b41ce-d377-4cd4-8d0c-17307808ef00 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:25:59.853518 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-253b41ce-d377-4cd4-8d0c-17307808ef00 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:25:59.868324 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-253b41ce-d377-4cd4-8d0c-17307808ef00 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:59.869037 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-253b41ce-d377-4cd4-8d0c-17307808ef00 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:25:59.870916 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-253b41ce-d377-4cd4-8d0c-17307808ef00 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:25:59.871547 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-253b41ce-d377-4cd4-8d0c-17307808ef00 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:00.679267 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-253b41ce-d377-4cd4-8d0c-17307808ef00 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:00.689099 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-253b41ce-d377-4cd4-8d0c-17307808ef00 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:00.690598 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-253b41ce-d377-4cd4-8d0c-17307808ef00 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:00.691776 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-253b41ce-d377-4cd4-8d0c-17307808ef00 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.871688 May 17 17:26:00.692334 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 282/507] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:25:59 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:26:00.713355 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c9f9de2d-3ce1-4106-8eef-2d66a19363c5 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:00.714587 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c9f9de2d-3ce1-4106-8eef-2d66a19363c5 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:00.720963 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c9f9de2d-3ce1-4106-8eef-2d66a19363c5 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:00.721404 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c9f9de2d-3ce1-4106-8eef-2d66a19363c5 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:00.722339 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c9f9de2d-3ce1-4106-8eef-2d66a19363c5 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:00.722922 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c9f9de2d-3ce1-4106-8eef-2d66a19363c5 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:01.137674 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c9f9de2d-3ce1-4106-8eef-2d66a19363c5 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d565f5725984bf6908fd35b557f8736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e4a7b9a0a74c2788facfa3035fc8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:01.145283 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c9f9de2d-3ce1-4106-8eef-2d66a19363c5 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37" status: 200 len: 1566 microversion: 2.1 time: 0.435768 May 17 17:26:01.146364 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 226/508] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:00 2022] GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 => generated 1566 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:01.206930 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-77f07f0b-0505-457a-9af0-bbf8dc1c7049 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:26:01.218322 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-77f07f0b-0505-457a-9af0-bbf8dc1c7049 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:01.219863 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-77f07f0b-0505-457a-9af0-bbf8dc1c7049 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:01.247374 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-77f07f0b-0505-457a-9af0-bbf8dc1c7049 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Going to try to stop instance {{(pid=117612) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 17 17:26:01.416538 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-77f07f0b-0505-457a-9af0-bbf8dc1c7049 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "POST /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f/action" status: 202 len: 0 microversion: 2.1 time: 0.227892 May 17 17:26:01.417145 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 283/509] 10.222.0.88 () {60 vars in 1277 bytes} [Tue May 17 17:26:01 2022] POST /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:26:01.425488 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-515f52b7-1343-4945-91f8-79df06f5fad7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:01.426102 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-515f52b7-1343-4945-91f8-79df06f5fad7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:01.432926 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-515f52b7-1343-4945-91f8-79df06f5fad7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:01.433582 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-515f52b7-1343-4945-91f8-79df06f5fad7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:01.434359 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-515f52b7-1343-4945-91f8-79df06f5fad7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:01.435119 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-515f52b7-1343-4945-91f8-79df06f5fad7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:01.712118 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f59b5e7f-be03-4367-b555-a2f9cb846134 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:01.712822 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f59b5e7f-be03-4367-b555-a2f9cb846134 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:01.745837 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f59b5e7f-be03-4367-b555-a2f9cb846134 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:01.746572 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f59b5e7f-be03-4367-b555-a2f9cb846134 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:01.747558 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f59b5e7f-be03-4367-b555-a2f9cb846134 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:01.747987 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f59b5e7f-be03-4367-b555-a2f9cb846134 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:01.978862 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-515f52b7-1343-4945-91f8-79df06f5fad7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:01.995334 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-515f52b7-1343-4945-91f8-79df06f5fad7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1676 microversion: 2.1 time: 0.573717 May 17 17:26:01.995960 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 227/510] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:01 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1676 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:02.000800 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-e4fd4a22-287e-45bc-a53d-0fd32aab5915 req-be216ac5-c5a4-442b-92c1-625b3b59e2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf11f0d-a455-430a-b320-5163e1b98b37", "name": "network-vif-deleted", "tag": "78dcbc08-7968-4aa1-95fa-f2034bb56aae"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:26:02.011679 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-e4fd4a22-287e-45bc-a53d-0fd32aab5915 req-be216ac5-c5a4-442b-92c1-625b3b59e2b7 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:02.012298 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-e4fd4a22-287e-45bc-a53d-0fd32aab5915 req-be216ac5-c5a4-442b-92c1-625b3b59e2b7 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:02.026581 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-e4fd4a22-287e-45bc-a53d-0fd32aab5915 req-be216ac5-c5a4-442b-92c1-625b3b59e2b7 service nova] Creating event network-vif-deleted:78dcbc08-7968-4aa1-95fa-f2034bb56aae for instance 9bf11f0d-a455-430a-b320-5163e1b98b37 on hv-cinder-84214 May 17 17:26:02.032272 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-e4fd4a22-287e-45bc-a53d-0fd32aab5915 req-be216ac5-c5a4-442b-92c1-625b3b59e2b7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034678 May 17 17:26:02.032881 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 228/511] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:26:02.118084 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f59b5e7f-be03-4367-b555-a2f9cb846134 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:02.127760 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f59b5e7f-be03-4367-b555-a2f9cb846134 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:02.129404 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f59b5e7f-be03-4367-b555-a2f9cb846134 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:02.130827 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f59b5e7f-be03-4367-b555-a2f9cb846134 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.423499 May 17 17:26:02.131410 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 284/512] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:26:01 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:26:02.166086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ae65fbfd-023e-4bdd-aa26-de3532474edd tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:02.166786 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ae65fbfd-023e-4bdd-aa26-de3532474edd tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:02.179495 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ae65fbfd-023e-4bdd-aa26-de3532474edd tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:02.180190 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ae65fbfd-023e-4bdd-aa26-de3532474edd tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:02.183066 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ae65fbfd-023e-4bdd-aa26-de3532474edd tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:02.183066 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ae65fbfd-023e-4bdd-aa26-de3532474edd tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:02.321997 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ae65fbfd-023e-4bdd-aa26-de3532474edd tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d565f5725984bf6908fd35b557f8736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e4a7b9a0a74c2788facfa3035fc8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:02.334542 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ae65fbfd-023e-4bdd-aa26-de3532474edd tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37" status: 200 len: 1499 microversion: 2.1 time: 0.175592 May 17 17:26:02.336022 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 229/513] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:02 2022] GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 => generated 1499 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:03.013046 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-49cde938-420f-4656-bc70-5d6d0cb705d2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:03.015256 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-49cde938-420f-4656-bc70-5d6d0cb705d2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:03.023055 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-49cde938-420f-4656-bc70-5d6d0cb705d2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:03.023838 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-49cde938-420f-4656-bc70-5d6d0cb705d2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:03.024858 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-49cde938-420f-4656-bc70-5d6d0cb705d2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:03.025838 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-49cde938-420f-4656-bc70-5d6d0cb705d2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:03.150753 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4d79f5d5-a9e3-46d6-90c7-4f810c6ca3b0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:03.152162 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4d79f5d5-a9e3-46d6-90c7-4f810c6ca3b0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:03.159578 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4d79f5d5-a9e3-46d6-90c7-4f810c6ca3b0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:03.160390 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4d79f5d5-a9e3-46d6-90c7-4f810c6ca3b0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:03.162123 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4d79f5d5-a9e3-46d6-90c7-4f810c6ca3b0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:03.162791 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4d79f5d5-a9e3-46d6-90c7-4f810c6ca3b0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:03.285821 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-49cde938-420f-4656-bc70-5d6d0cb705d2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:03.315761 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-49cde938-420f-4656-bc70-5d6d0cb705d2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1676 microversion: 2.1 time: 0.294999 May 17 17:26:03.329633 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 285/514] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:03 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1676 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:03.354210 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-80d1b1d8-e5a8-48b6-84eb-d9827d06d8bb tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:03.357493 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-80d1b1d8-e5a8-48b6-84eb-d9827d06d8bb tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:03.367912 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-80d1b1d8-e5a8-48b6-84eb-d9827d06d8bb tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:03.371368 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-80d1b1d8-e5a8-48b6-84eb-d9827d06d8bb tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:03.372427 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-80d1b1d8-e5a8-48b6-84eb-d9827d06d8bb tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:03.373041 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-80d1b1d8-e5a8-48b6-84eb-d9827d06d8bb tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:03.445284 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4d79f5d5-a9e3-46d6-90c7-4f810c6ca3b0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:03.455257 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4d79f5d5-a9e3-46d6-90c7-4f810c6ca3b0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:03.456965 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4d79f5d5-a9e3-46d6-90c7-4f810c6ca3b0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:03.459286 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4d79f5d5-a9e3-46d6-90c7-4f810c6ca3b0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1808 microversion: 2.20 time: 0.313522 May 17 17:26:03.466903 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-80d1b1d8-e5a8-48b6-84eb-d9827d06d8bb tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d565f5725984bf6908fd35b557f8736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e4a7b9a0a74c2788facfa3035fc8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:03.470588 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 230/515] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:26:03 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1808 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:26:03.477625 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-80d1b1d8-e5a8-48b6-84eb-d9827d06d8bb tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37" status: 200 len: 1381 microversion: 2.1 time: 0.129220 May 17 17:26:03.478551 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 286/516] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:03 2022] GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 => generated 1381 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:26:03.968096 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d95f2aeb-e217-4ace-9830-38bcbd51eb57 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Action: 'create', calling method: .version_select at 0x7f73d00914c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-647335372", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0q8K/1V9zzwHF0+bba5VtPK9qoa3wtACmykXvXfxK87Vd+M5CqPyXzXL/9O0wnGSN411JQa3HIUHMmeOIV2k1uyftXsEZd4f9G3ffqi8hBrCUfKvmQgCQPoowqjnBV4w=="}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:26:03.992857 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-d95f2aeb-e217-4ace-9830-38bcbd51eb57 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Getting quotas for project 3f5eec12182649ba98446cf774faf873. Resources: {'key_pairs'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:26:03.997633 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-d95f2aeb-e217-4ace-9830-38bcbd51eb57 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Getting quotas for user 6cbe2975d6d24b4280a28056afaeb873 and project 3f5eec12182649ba98446cf774faf873. Resources: {'key_pairs'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:26:04.122859 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d95f2aeb-e217-4ace-9830-38bcbd51eb57 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.380793 May 17 17:26:04.123456 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 231/517] 10.222.0.88 () {60 vars in 1158 bytes} [Tue May 17 17:26:03 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:26:04.338335 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-592a4b5f-1650-438a-bc26-0f7d75ff67e8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:04.340119 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-592a4b5f-1650-438a-bc26-0f7d75ff67e8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:04.352104 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-592a4b5f-1650-438a-bc26-0f7d75ff67e8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:04.352626 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-592a4b5f-1650-438a-bc26-0f7d75ff67e8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:04.353517 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-592a4b5f-1650-438a-bc26-0f7d75ff67e8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:04.353953 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-592a4b5f-1650-438a-bc26-0f7d75ff67e8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:04.478290 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-fc9eca00-e7f4-46f9-8af6-fb374ee0673c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:04.479027 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-fc9eca00-e7f4-46f9-8af6-fb374ee0673c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:04.494577 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fc9eca00-e7f4-46f9-8af6-fb374ee0673c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:04.494577 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fc9eca00-e7f4-46f9-8af6-fb374ee0673c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:04.495243 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fc9eca00-e7f4-46f9-8af6-fb374ee0673c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:04.495717 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fc9eca00-e7f4-46f9-8af6-fb374ee0673c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:04.571717 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-592a4b5f-1650-438a-bc26-0f7d75ff67e8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:04.581087 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-592a4b5f-1650-438a-bc26-0f7d75ff67e8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1676 microversion: 2.1 time: 0.248524 May 17 17:26:04.585158 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 287/518] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:04 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1676 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:04.591396 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c6bb3937-e8ec-449b-986b-d08de4f8fc54 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:04.601306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c6bb3937-e8ec-449b-986b-d08de4f8fc54 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] [instance: 9bf11f0d-a455-430a-b320-5163e1b98b37] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:04.611572 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c6bb3937-e8ec-449b-986b-d08de4f8fc54 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:04.612831 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c6bb3937-e8ec-449b-986b-d08de4f8fc54 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:04.615257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c6bb3937-e8ec-449b-986b-d08de4f8fc54 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:04.615799 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c6bb3937-e8ec-449b-986b-d08de4f8fc54 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:04.634137 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-c6bb3937-e8ec-449b-986b-d08de4f8fc54 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] HTTP exception thrown: Instance 9bf11f0d-a455-430a-b320-5163e1b98b37 could not be found. May 17 17:26:04.636239 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c6bb3937-e8ec-449b-986b-d08de4f8fc54 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Request method failure captured: May 17 17:26:04.636239 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: request: GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 HTTP/1.1 May 17 17:26:04.636239 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 17 17:26:04.636239 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 17 17:26:04.636239 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Connection: close May 17 17:26:04.636239 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 17 17:26:04.636239 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 17 17:26:04.636239 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.88 May 17 17:26:04.636239 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 17 17:26:04.636239 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 17 17:26:04.636239 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABig9n9RJpB1fxMAorYcgyS7JbOhvhjD_0dy1vfHEULHThtxhsRGJ_CIEqA5H7HVp5Lw_jMpTWDdzXcrlXz8LGAsj_-jyDXwqNRlQ-MRVqP1EX2GuVr0FJLlfdc1HIAkCwZ8ZIBrPPQmPWlToZUtKIdq_N1CCDXJ4N-j6AAQ6Jsb-_fzeE May 17 17:26:04.636239 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 17 17:26:04.636239 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 17 17:26:04.636239 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 17 17:26:04.636239 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 17 17:26:04.636239 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 17 17:26:04.636239 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 17 17:26:04.636239 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 60e4a7b9a0a74c2788facfa3035fc8ab May 17 17:26:04.636239 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-TestShelveInstance-744754579 May 17 17:26:04.636239 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Role: reader,member May 17 17:26:04.636239 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Roles: reader,member May 17 17:26:04.637740 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/60e4a7b9a0a74c2788facfa3035fc8ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/60e4a7b9a0a74c2788facfa3035fc8ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/60e4a7b9a0a74c2788facfa3035fc8ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_60e4a7b9a0a74c2788facfa3035fc8ab", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:26:04.637740 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-TestShelveInstance-744754579 May 17 17:26:04.637740 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 60e4a7b9a0a74c2788facfa3035fc8ab May 17 17:26:04.637740 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-TestShelveInstance-744754579 May 17 17:26:04.637740 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User: tempest-TestShelveInstance-744754579-project May 17 17:26:04.637740 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 17 17:26:04.637740 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 17 17:26:04.637740 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Id: 0d565f5725984bf6908fd35b557f8736 May 17 17:26:04.637740 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-TestShelveInstance-744754579-project May 17 17:26:04.637740 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: method: > May 17 17:26:04.637740 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: exception: Instance 9bf11f0d-a455-430a-b320-5163e1b98b37 could not be found. May 17 17:26:04.637740 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: action_args: {'id': '9bf11f0d-a455-430a-b320-5163e1b98b37'} May 17 17:26:04.638579 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:26:04.638579 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:26:04.638579 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:26:04.638579 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:26:04.638579 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:26:04.638579 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:26:04.638579 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:26:04.638579 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:26:04.638579 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:26:04.638579 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:26:04.638579 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bf11f0d-a455-430a-b320-5163e1b98b37 could not be found. May 17 17:26:04.638579 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:26:04.638579 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:26:04.638579 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:26:04.638579 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:26:04.638579 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:26:04.638579 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:26:04.638579 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:26:04.638579 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:26:04.638579 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:26:04.639864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:26:04.639864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:26:04.639864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:26:04.639864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:26:04.639864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:26:04.639864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:26:04.639864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:26:04.639864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bf11f0d-a455-430a-b320-5163e1b98b37 could not be found. May 17 17:26:04.639864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:26:04.639864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:26:04.639864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:26:04.639864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:26:04.639864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:26:04.639864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:26:04.639864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:26:04.639864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:26:04.639864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bf11f0d-a455-430a-b320-5163e1b98b37 could not be found. May 17 17:26:04.639864 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:26:04.642407 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c6bb3937-e8ec-449b-986b-d08de4f8fc54 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Returning 404 to user: Instance 9bf11f0d-a455-430a-b320-5163e1b98b37 could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:26:04.643463 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c6bb3937-e8ec-449b-986b-d08de4f8fc54 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37" status: 404 len: 111 microversion: 2.1 time: 0.057012 May 17 17:26:04.644227 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 288/519] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:04 2022] GET /compute/v2.1/servers/9bf11f0d-a455-430a-b320-5163e1b98b37 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:26:04.674548 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-fc9eca00-e7f4-46f9-8af6-fb374ee0673c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:04.683984 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-fc9eca00-e7f4-46f9-8af6-fb374ee0673c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:04.685765 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-fc9eca00-e7f4-46f9-8af6-fb374ee0673c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:04.687204 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-fc9eca00-e7f4-46f9-8af6-fb374ee0673c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1795 microversion: 2.20 time: 0.213476 May 17 17:26:04.688205 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 232/520] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:26:04 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1795 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:26:04.952010 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f718fdd7-5acd-455a-912a-0dc6c88a2620 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] Calling method '.version_select at 0x7f73d01878b0>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:05.087900 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f718fdd7-5acd-455a-912a-0dc6c88a2620 tempest-TestShelveInstance-744754579 tempest-TestShelveInstance-744754579-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-733781755" status: 202 len: 0 microversion: 2.1 time: 0.139906 May 17 17:26:05.095606 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 289/521] 10.222.0.88 () {58 vars in 1250 bytes} [Tue May 17 17:26:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-733781755 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 17 17:26:05.605610 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-98e7b54a-8d53-4b55-b1f8-84cfad331acf tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:05.606936 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-98e7b54a-8d53-4b55-b1f8-84cfad331acf tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:05.616652 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-98e7b54a-8d53-4b55-b1f8-84cfad331acf tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:05.617100 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-98e7b54a-8d53-4b55-b1f8-84cfad331acf tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:05.617881 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-98e7b54a-8d53-4b55-b1f8-84cfad331acf tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:05.624533 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-98e7b54a-8d53-4b55-b1f8-84cfad331acf tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:05.923392 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-98e7b54a-8d53-4b55-b1f8-84cfad331acf tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:05.936674 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-98e7b54a-8d53-4b55-b1f8-84cfad331acf tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1676 microversion: 2.1 time: 0.334575 May 17 17:26:05.939682 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 233/522] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:05 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1676 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:06.954167 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-fea05179-b04d-4b15-84ed-ce08826b4b96 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:06.954766 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-fea05179-b04d-4b15-84ed-ce08826b4b96 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:06.961419 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fea05179-b04d-4b15-84ed-ce08826b4b96 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:06.961862 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fea05179-b04d-4b15-84ed-ce08826b4b96 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:06.962632 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fea05179-b04d-4b15-84ed-ce08826b4b96 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:06.963064 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fea05179-b04d-4b15-84ed-ce08826b4b96 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:07.358707 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-fea05179-b04d-4b15-84ed-ce08826b4b96 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:07.367739 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-fea05179-b04d-4b15-84ed-ce08826b4b96 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1676 microversion: 2.1 time: 0.417328 May 17 17:26:07.368307 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 290/523] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:06 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1676 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:08.385715 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c127c9fd-e650-43c2-8e53-bb8600252945 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:08.386445 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c127c9fd-e650-43c2-8e53-bb8600252945 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:08.400387 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c127c9fd-e650-43c2-8e53-bb8600252945 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:08.400832 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c127c9fd-e650-43c2-8e53-bb8600252945 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:08.401615 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c127c9fd-e650-43c2-8e53-bb8600252945 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:08.402047 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c127c9fd-e650-43c2-8e53-bb8600252945 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:08.429518 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-490e5c61-0602-4b11-bc8c-421e287d4d76 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:26:08.430697 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-490e5c61-0602-4b11-bc8c-421e287d4d76 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:08.437960 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-490e5c61-0602-4b11-bc8c-421e287d4d76 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:08.441387 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-490e5c61-0602-4b11-bc8c-421e287d4d76 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:08.442233 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-490e5c61-0602-4b11-bc8c-421e287d4d76 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:08.443232 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-490e5c61-0602-4b11-bc8c-421e287d4d76 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:08.479337 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-490e5c61-0602-4b11-bc8c-421e287d4d76 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lazy-loading 'flavor' on Instance uuid de553cb6-1884-4291-a670-74718d9705e0 {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:26:08.684406 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c127c9fd-e650-43c2-8e53-bb8600252945 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:08.691875 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c127c9fd-e650-43c2-8e53-bb8600252945 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1676 microversion: 2.1 time: 0.309995 May 17 17:26:08.699725 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 234/524] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:08 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1676 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:26:08.872171 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-490e5c61-0602-4b11-bc8c-421e287d4d76 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "POST /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0/action" status: 200 len: 32 microversion: 2.1 time: 0.447870 May 17 17:26:08.873393 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 291/525] 10.222.0.88 () {60 vars in 1277 bytes} [Tue May 17 17:26:08 2022] POST /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0/action => generated 32 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 17 17:26:08.884227 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-68fe0edf-9d55-43ea-88c5-179ae4a719ca tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:08.885238 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-68fe0edf-9d55-43ea-88c5-179ae4a719ca tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:08.895207 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-68fe0edf-9d55-43ea-88c5-179ae4a719ca tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:08.897875 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-68fe0edf-9d55-43ea-88c5-179ae4a719ca tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:08.903140 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-68fe0edf-9d55-43ea-88c5-179ae4a719ca tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:08.905198 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-68fe0edf-9d55-43ea-88c5-179ae4a719ca tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:09.238862 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-68fe0edf-9d55-43ea-88c5-179ae4a719ca tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:09.248079 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-68fe0edf-9d55-43ea-88c5-179ae4a719ca tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1735 microversion: 2.1 time: 0.369632 May 17 17:26:09.248655 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 235/526] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:08 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1735 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:09.715591 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f07e96f3-6ad4-478f-ba55-21a5092ba9b7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:09.716398 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f07e96f3-6ad4-478f-ba55-21a5092ba9b7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:09.722727 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f07e96f3-6ad4-478f-ba55-21a5092ba9b7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:09.723290 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f07e96f3-6ad4-478f-ba55-21a5092ba9b7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:09.724733 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f07e96f3-6ad4-478f-ba55-21a5092ba9b7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:09.725264 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f07e96f3-6ad4-478f-ba55-21a5092ba9b7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:10.009412 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f07e96f3-6ad4-478f-ba55-21a5092ba9b7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:10.017962 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f07e96f3-6ad4-478f-ba55-21a5092ba9b7 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1676 microversion: 2.1 time: 0.311115 May 17 17:26:10.018600 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 292/527] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:09 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1676 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:10.265927 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6b61b576-b0d9-4208-a056-41e09f271019 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:10.266618 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6b61b576-b0d9-4208-a056-41e09f271019 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:10.276789 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6b61b576-b0d9-4208-a056-41e09f271019 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:10.277245 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6b61b576-b0d9-4208-a056-41e09f271019 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:10.278028 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6b61b576-b0d9-4208-a056-41e09f271019 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:10.278460 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6b61b576-b0d9-4208-a056-41e09f271019 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:10.422098 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6b61b576-b0d9-4208-a056-41e09f271019 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:10.430529 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6b61b576-b0d9-4208-a056-41e09f271019 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1735 microversion: 2.1 time: 0.168710 May 17 17:26:10.431100 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 236/528] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:10 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:11.035715 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-86321bb2-b4aa-4be1-9c67-fa1ce1991c96 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:11.036903 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-86321bb2-b4aa-4be1-9c67-fa1ce1991c96 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:11.044119 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-86321bb2-b4aa-4be1-9c67-fa1ce1991c96 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:11.044575 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-86321bb2-b4aa-4be1-9c67-fa1ce1991c96 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:11.045353 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-86321bb2-b4aa-4be1-9c67-fa1ce1991c96 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:11.045782 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-86321bb2-b4aa-4be1-9c67-fa1ce1991c96 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:11.200178 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-86321bb2-b4aa-4be1-9c67-fa1ce1991c96 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:11.208487 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-86321bb2-b4aa-4be1-9c67-fa1ce1991c96 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1676 microversion: 2.1 time: 0.176666 May 17 17:26:11.209691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 293/529] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:11 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:11.448633 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e5ad857f-8ac3-4393-9a6c-58e1ddeeb669 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:11.449410 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e5ad857f-8ac3-4393-9a6c-58e1ddeeb669 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:11.455455 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e5ad857f-8ac3-4393-9a6c-58e1ddeeb669 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:11.456105 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e5ad857f-8ac3-4393-9a6c-58e1ddeeb669 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:11.456910 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e5ad857f-8ac3-4393-9a6c-58e1ddeeb669 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:11.457525 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e5ad857f-8ac3-4393-9a6c-58e1ddeeb669 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:11.605596 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e5ad857f-8ac3-4393-9a6c-58e1ddeeb669 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:11.613663 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e5ad857f-8ac3-4393-9a6c-58e1ddeeb669 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1735 microversion: 2.1 time: 0.169030 May 17 17:26:11.614246 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 237/530] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:11 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:12.226191 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-992ad122-e038-49e4-824d-d82e79567718 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:12.228001 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-992ad122-e038-49e4-824d-d82e79567718 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:12.233903 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-992ad122-e038-49e4-824d-d82e79567718 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:12.234296 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-992ad122-e038-49e4-824d-d82e79567718 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:12.235071 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-992ad122-e038-49e4-824d-d82e79567718 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:12.235536 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-992ad122-e038-49e4-824d-d82e79567718 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:12.406190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-992ad122-e038-49e4-824d-d82e79567718 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:12.419417 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-992ad122-e038-49e4-824d-d82e79567718 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1676 microversion: 2.1 time: 0.197056 May 17 17:26:12.420143 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 294/531] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:12 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1676 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:12.634738 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a7391178-2cbc-41e9-9deb-2e95b170278f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:12.635968 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a7391178-2cbc-41e9-9deb-2e95b170278f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:12.643032 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a7391178-2cbc-41e9-9deb-2e95b170278f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:12.643608 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a7391178-2cbc-41e9-9deb-2e95b170278f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:12.644470 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a7391178-2cbc-41e9-9deb-2e95b170278f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:12.644983 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a7391178-2cbc-41e9-9deb-2e95b170278f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:12.800887 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a7391178-2cbc-41e9-9deb-2e95b170278f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:12.811145 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a7391178-2cbc-41e9-9deb-2e95b170278f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1735 microversion: 2.1 time: 0.183548 May 17 17:26:12.812156 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 238/532] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:12 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:13.437025 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c06f3e70-115d-4b16-a7bd-b676aebcdd22 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:13.439009 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c06f3e70-115d-4b16-a7bd-b676aebcdd22 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:13.445155 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c06f3e70-115d-4b16-a7bd-b676aebcdd22 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:13.445603 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c06f3e70-115d-4b16-a7bd-b676aebcdd22 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:13.446439 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c06f3e70-115d-4b16-a7bd-b676aebcdd22 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:13.446881 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c06f3e70-115d-4b16-a7bd-b676aebcdd22 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:13.717954 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c06f3e70-115d-4b16-a7bd-b676aebcdd22 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:13.727678 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c06f3e70-115d-4b16-a7bd-b676aebcdd22 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1653 microversion: 2.1 time: 0.294377 May 17 17:26:13.728484 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 295/533] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:13 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1653 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:13.745192 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b254b98e-a8c8-4de4-ba1c-a596d723f557 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:26:13.751707 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b254b98e-a8c8-4de4-ba1c-a596d723f557 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:13.752159 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b254b98e-a8c8-4de4-ba1c-a596d723f557 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:13.819122 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b254b98e-a8c8-4de4-ba1c-a596d723f557 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Going to try to start instance {{(pid=117611) start /opt/stack/nova/nova/compute/api.py:2730}} May 17 17:26:13.829567 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b01ef942-fd8b-4f9b-a135-c46871c0f28e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:13.830173 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b01ef942-fd8b-4f9b-a135-c46871c0f28e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:13.837076 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b01ef942-fd8b-4f9b-a135-c46871c0f28e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:13.837529 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b01ef942-fd8b-4f9b-a135-c46871c0f28e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:13.838388 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b01ef942-fd8b-4f9b-a135-c46871c0f28e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:13.839002 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b01ef942-fd8b-4f9b-a135-c46871c0f28e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:14.001118 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b01ef942-fd8b-4f9b-a135-c46871c0f28e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:14.009484 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b01ef942-fd8b-4f9b-a135-c46871c0f28e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1735 microversion: 2.1 time: 0.183877 May 17 17:26:14.010030 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 296/534] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:13 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:26:14.021238 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b254b98e-a8c8-4de4-ba1c-a596d723f557 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "POST /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f/action" status: 202 len: 0 microversion: 2.1 time: 0.279635 May 17 17:26:14.021912 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 239/535] 10.222.0.88 () {60 vars in 1277 bytes} [Tue May 17 17:26:13 2022] POST /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:26:14.029983 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-74795dbe-cd10-4ca3-8602-a3bcdaf34b21 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:14.030684 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-74795dbe-cd10-4ca3-8602-a3bcdaf34b21 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:14.038179 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-74795dbe-cd10-4ca3-8602-a3bcdaf34b21 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:14.039088 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-74795dbe-cd10-4ca3-8602-a3bcdaf34b21 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:14.040152 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-74795dbe-cd10-4ca3-8602-a3bcdaf34b21 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:14.040595 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-74795dbe-cd10-4ca3-8602-a3bcdaf34b21 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:14.177336 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-74795dbe-cd10-4ca3-8602-a3bcdaf34b21 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:14.184755 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-74795dbe-cd10-4ca3-8602-a3bcdaf34b21 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1662 microversion: 2.1 time: 0.158627 May 17 17:26:14.185300 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 297/536] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:14 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1662 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:26:15.027467 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8f429ab3-2d9f-46ac-a4bd-3406a19ddd59 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:15.028321 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8f429ab3-2d9f-46ac-a4bd-3406a19ddd59 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:15.034689 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8f429ab3-2d9f-46ac-a4bd-3406a19ddd59 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:15.035136 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8f429ab3-2d9f-46ac-a4bd-3406a19ddd59 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:15.035940 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8f429ab3-2d9f-46ac-a4bd-3406a19ddd59 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:15.036884 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8f429ab3-2d9f-46ac-a4bd-3406a19ddd59 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:15.178522 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8f429ab3-2d9f-46ac-a4bd-3406a19ddd59 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:15.186413 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8f429ab3-2d9f-46ac-a4bd-3406a19ddd59 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1735 microversion: 2.1 time: 0.163657 May 17 17:26:15.186970 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 240/537] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:15 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:15.201603 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c847ea64-1146-44a8-9809-8109a8b0a4ad tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:15.205551 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c847ea64-1146-44a8-9809-8109a8b0a4ad tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:15.212022 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c847ea64-1146-44a8-9809-8109a8b0a4ad tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:15.212550 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c847ea64-1146-44a8-9809-8109a8b0a4ad tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:15.213351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c847ea64-1146-44a8-9809-8109a8b0a4ad tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:15.213788 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c847ea64-1146-44a8-9809-8109a8b0a4ad tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:15.348384 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c847ea64-1146-44a8-9809-8109a8b0a4ad tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:15.355625 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c847ea64-1146-44a8-9809-8109a8b0a4ad tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1662 microversion: 2.1 time: 0.157956 May 17 17:26:15.356248 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 298/538] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:15 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1662 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:16.203329 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-330a7b2a-61f0-49b7-b380-463bd85fba66 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:16.204079 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-330a7b2a-61f0-49b7-b380-463bd85fba66 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:16.210680 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-330a7b2a-61f0-49b7-b380-463bd85fba66 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:16.211163 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-330a7b2a-61f0-49b7-b380-463bd85fba66 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:16.211999 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-330a7b2a-61f0-49b7-b380-463bd85fba66 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:16.212456 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-330a7b2a-61f0-49b7-b380-463bd85fba66 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:16.345334 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-330a7b2a-61f0-49b7-b380-463bd85fba66 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:16.353852 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-330a7b2a-61f0-49b7-b380-463bd85fba66 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1735 microversion: 2.1 time: 0.154360 May 17 17:26:16.354420 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 241/539] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:16 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:16.373100 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5b17c4e1-5905-4e64-9c53-a83f62aee97e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:16.373709 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5b17c4e1-5905-4e64-9c53-a83f62aee97e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:16.379551 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5b17c4e1-5905-4e64-9c53-a83f62aee97e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:16.380068 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5b17c4e1-5905-4e64-9c53-a83f62aee97e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:16.380828 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5b17c4e1-5905-4e64-9c53-a83f62aee97e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:16.381261 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5b17c4e1-5905-4e64-9c53-a83f62aee97e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:16.511671 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5b17c4e1-5905-4e64-9c53-a83f62aee97e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:16.519104 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5b17c4e1-5905-4e64-9c53-a83f62aee97e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1666 microversion: 2.1 time: 0.149752 May 17 17:26:16.519750 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 299/540] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:16 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1666 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:17.371253 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-90d41f56-297d-485f-8c4a-7a846bdc117a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:17.371878 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-90d41f56-297d-485f-8c4a-7a846bdc117a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:17.378148 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-90d41f56-297d-485f-8c4a-7a846bdc117a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:17.378591 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-90d41f56-297d-485f-8c4a-7a846bdc117a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:17.379338 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-90d41f56-297d-485f-8c4a-7a846bdc117a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:17.379798 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-90d41f56-297d-485f-8c4a-7a846bdc117a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:17.510101 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-90d41f56-297d-485f-8c4a-7a846bdc117a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:17.518974 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-90d41f56-297d-485f-8c4a-7a846bdc117a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1735 microversion: 2.1 time: 0.151416 May 17 17:26:17.519737 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 242/541] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:17 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:18.536205 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-008cf2b3-5866-4249-8141-1ea87cadab55 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:18.536818 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-008cf2b3-5866-4249-8141-1ea87cadab55 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:18.542758 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-008cf2b3-5866-4249-8141-1ea87cadab55 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:18.543327 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-008cf2b3-5866-4249-8141-1ea87cadab55 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:18.544164 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-008cf2b3-5866-4249-8141-1ea87cadab55 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:18.544597 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-008cf2b3-5866-4249-8141-1ea87cadab55 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:18.672261 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-008cf2b3-5866-4249-8141-1ea87cadab55 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:18.679889 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-008cf2b3-5866-4249-8141-1ea87cadab55 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1735 microversion: 2.1 time: 0.147718 May 17 17:26:18.680446 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 300/542] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:18 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:19.696580 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f875f7cc-fb3d-42aa-88a3-61c5de122d16 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:19.697183 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f875f7cc-fb3d-42aa-88a3-61c5de122d16 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:19.703435 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f875f7cc-fb3d-42aa-88a3-61c5de122d16 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:19.703908 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f875f7cc-fb3d-42aa-88a3-61c5de122d16 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:19.704658 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f875f7cc-fb3d-42aa-88a3-61c5de122d16 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:19.705086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f875f7cc-fb3d-42aa-88a3-61c5de122d16 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:19.833216 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f875f7cc-fb3d-42aa-88a3-61c5de122d16 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:19.840940 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f875f7cc-fb3d-42aa-88a3-61c5de122d16 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1735 microversion: 2.1 time: 0.148164 May 17 17:26:19.841497 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 243/543] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:19 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:20.858424 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7b788753-2f87-40b1-a1cc-a5bcfc6ecfb0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:20.859069 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-7b788753-2f87-40b1-a1cc-a5bcfc6ecfb0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:20.865624 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7b788753-2f87-40b1-a1cc-a5bcfc6ecfb0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:20.866071 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7b788753-2f87-40b1-a1cc-a5bcfc6ecfb0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:20.866833 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7b788753-2f87-40b1-a1cc-a5bcfc6ecfb0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:20.867264 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7b788753-2f87-40b1-a1cc-a5bcfc6ecfb0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:20.990592 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7b788753-2f87-40b1-a1cc-a5bcfc6ecfb0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:20.998286 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7b788753-2f87-40b1-a1cc-a5bcfc6ecfb0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1735 microversion: 2.1 time: 0.143728 May 17 17:26:20.998852 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 301/544] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:20 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:22.016013 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-0a30ec1c-c488-4e10-8713-e820f2bcf3a1 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:22.016625 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-0a30ec1c-c488-4e10-8713-e820f2bcf3a1 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:22.023445 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0a30ec1c-c488-4e10-8713-e820f2bcf3a1 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:22.023925 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0a30ec1c-c488-4e10-8713-e820f2bcf3a1 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:22.024699 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0a30ec1c-c488-4e10-8713-e820f2bcf3a1 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:22.025136 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0a30ec1c-c488-4e10-8713-e820f2bcf3a1 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:22.155286 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-0a30ec1c-c488-4e10-8713-e820f2bcf3a1 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:22.164020 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-0a30ec1c-c488-4e10-8713-e820f2bcf3a1 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1735 microversion: 2.1 time: 0.151908 May 17 17:26:22.164583 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 244/545] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:22 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:23.181307 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f98e3042-63eb-4ae3-8700-630187916db2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:23.181914 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f98e3042-63eb-4ae3-8700-630187916db2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:23.187994 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f98e3042-63eb-4ae3-8700-630187916db2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:23.188443 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f98e3042-63eb-4ae3-8700-630187916db2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:23.189216 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f98e3042-63eb-4ae3-8700-630187916db2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:23.189666 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f98e3042-63eb-4ae3-8700-630187916db2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:23.316531 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f98e3042-63eb-4ae3-8700-630187916db2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:23.319742 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-86bcd4e4-4414-4099-a5ac-481e89fa67f0 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1970650183", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-647335372", "security_groups": [{"name": "tempest-secgroup-smoke-42262070"}], "block_device_mapping_v2": [{"uuid": "62f07cd5-2a21-48cd-bafa-6dd65b8d819a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fcf7be69-9ae2-4258-af0f-0fdac2597600"}]}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:26:23.325078 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f98e3042-63eb-4ae3-8700-630187916db2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1735 microversion: 2.1 time: 0.147529 May 17 17:26:23.325656 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 302/546] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:23 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:23.429311 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.network.neutron [None req-86bcd4e4-4414-4099-a5ac-481e89fa67f0 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] validate_networks() for [('fcf7be69-9ae2-4258-af0f-0fdac2597600', None, None, None, None, None)] {{(pid=117611) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:26:24.017583 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-86bcd4e4-4414-4099-a5ac-481e89fa67f0 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Flavor limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:26:24.018003 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-86bcd4e4-4414-4099-a5ac-481e89fa67f0 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Image limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:26:24.018475 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-86bcd4e4-4414-4099-a5ac-481e89fa67f0 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Flavor pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:26:24.018888 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-86bcd4e4-4414-4099-a5ac-481e89fa67f0 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Image pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:26:24.019299 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-86bcd4e4-4414-4099-a5ac-481e89fa67f0 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:26:24.028935 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-86bcd4e4-4414-4099-a5ac-481e89fa67f0 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:24.029387 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-86bcd4e4-4414-4099-a5ac-481e89fa67f0 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:24.030190 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-86bcd4e4-4414-4099-a5ac-481e89fa67f0 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:24.030629 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-86bcd4e4-4414-4099-a5ac-481e89fa67f0 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:24.047710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-86bcd4e4-4414-4099-a5ac-481e89fa67f0 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Getting quotas for project 3f5eec12182649ba98446cf774faf873. Resources: {'cores', 'ram', 'instances'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:26:24.052106 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-86bcd4e4-4414-4099-a5ac-481e89fa67f0 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Getting quotas for user 6cbe2975d6d24b4280a28056afaeb873 and project 3f5eec12182649ba98446cf774faf873. Resources: {'cores', 'ram', 'instances'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:26:24.106992 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-86bcd4e4-4414-4099-a5ac-481e89fa67f0 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Going to run 1 instances... {{(pid=117611) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:26:24.109124 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-86bcd4e4-4414-4099-a5ac-481e89fa67f0 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: d8ed82ef-aec7-43db-9bc8-7f925f7e75cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='62f07cd5-2a21-48cd-bafa-6dd65b8d819a',volume_size=None,volume_type=None)] {{(pid=117611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:26:24.342759 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f9b91313-59ae-443a-91e1-eee7211d90d9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:24.343304 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f9b91313-59ae-443a-91e1-eee7211d90d9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:24.350035 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f9b91313-59ae-443a-91e1-eee7211d90d9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:24.350508 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f9b91313-59ae-443a-91e1-eee7211d90d9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:24.351275 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f9b91313-59ae-443a-91e1-eee7211d90d9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:24.351747 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f9b91313-59ae-443a-91e1-eee7211d90d9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:24.484078 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f9b91313-59ae-443a-91e1-eee7211d90d9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:24.492038 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f9b91313-59ae-443a-91e1-eee7211d90d9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1735 microversion: 2.1 time: 0.153266 May 17 17:26:24.492594 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 303/547] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:24 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:26:24.503587 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR oslo.messaging._drivers.impl_rabbit [None req-86bcd4e4-4414-4099-a5ac-481e89fa67f0 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [fdfd148a-0fcb-4001-903b-420817602d9f] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 17 17:26:25.509987 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c9bd611f-0ff5-4ec2-a704-c23134c85115 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:25.510596 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c9bd611f-0ff5-4ec2-a704-c23134c85115 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:25.510741 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO oslo.messaging._drivers.impl_rabbit [None req-86bcd4e4-4414-4099-a5ac-481e89fa67f0 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [fdfd148a-0fcb-4001-903b-420817602d9f] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 35694. May 17 17:26:25.514702 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-86bcd4e4-4414-4099-a5ac-481e89fa67f0 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.199409 May 17 17:26:25.515564 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 245/548] 10.222.0.88 () {60 vars in 1146 bytes} [Tue May 17 17:26:23 2022] POST /compute/v2.1/servers => generated 404 bytes in 2201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 17 17:26:25.516582 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c9bd611f-0ff5-4ec2-a704-c23134c85115 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:25.517023 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c9bd611f-0ff5-4ec2-a704-c23134c85115 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:25.517785 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c9bd611f-0ff5-4ec2-a704-c23134c85115 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:25.518341 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c9bd611f-0ff5-4ec2-a704-c23134c85115 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:25.525908 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c063ae05-76f4-4153-b4bd-88202465fdc9 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:25.526526 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c063ae05-76f4-4153-b4bd-88202465fdc9 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: d8ed82ef-aec7-43db-9bc8-7f925f7e75cb] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:25.588497 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c063ae05-76f4-4153-b4bd-88202465fdc9 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:25.595167 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c063ae05-76f4-4153-b4bd-88202465fdc9 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb" status: 200 len: 1094 microversion: 2.1 time: 0.072910 May 17 17:26:25.595779 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 246/549] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:25 2022] GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:25.685191 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c9bd611f-0ff5-4ec2-a704-c23134c85115 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:25.693693 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c9bd611f-0ff5-4ec2-a704-c23134c85115 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1735 microversion: 2.1 time: 0.187576 May 17 17:26:25.705618 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 304/550] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:25 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:26:26.611834 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-2f8ee437-9a06-4354-8e7e-f8a0095a05c9 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:26.612489 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-2f8ee437-9a06-4354-8e7e-f8a0095a05c9 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: d8ed82ef-aec7-43db-9bc8-7f925f7e75cb] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:26.618895 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2f8ee437-9a06-4354-8e7e-f8a0095a05c9 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:26.622169 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2f8ee437-9a06-4354-8e7e-f8a0095a05c9 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:26.622169 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2f8ee437-9a06-4354-8e7e-f8a0095a05c9 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:26.622169 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2f8ee437-9a06-4354-8e7e-f8a0095a05c9 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:26.682894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2f8ee437-9a06-4354-8e7e-f8a0095a05c9 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:26.690481 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-2f8ee437-9a06-4354-8e7e-f8a0095a05c9 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb" status: 200 len: 1144 microversion: 2.1 time: 0.082541 May 17 17:26:26.697423 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 247/551] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:26 2022] GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:26.710323 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-29c31fd7-c04c-4de3-a3f1-daee1a3f71cb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:26.710923 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-29c31fd7-c04c-4de3-a3f1-daee1a3f71cb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:26.717151 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-29c31fd7-c04c-4de3-a3f1-daee1a3f71cb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:26.717595 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-29c31fd7-c04c-4de3-a3f1-daee1a3f71cb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:26.718354 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-29c31fd7-c04c-4de3-a3f1-daee1a3f71cb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:26.719071 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-29c31fd7-c04c-4de3-a3f1-daee1a3f71cb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:26.851714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-29c31fd7-c04c-4de3-a3f1-daee1a3f71cb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:26.859559 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-29c31fd7-c04c-4de3-a3f1-daee1a3f71cb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1735 microversion: 2.1 time: 0.153407 May 17 17:26:26.860117 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 305/552] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:26 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:27.707359 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5c1b1326-a019-47f6-9d06-1dcd0c23a30b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:27.708737 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-5c1b1326-a019-47f6-9d06-1dcd0c23a30b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: d8ed82ef-aec7-43db-9bc8-7f925f7e75cb] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:27.715643 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5c1b1326-a019-47f6-9d06-1dcd0c23a30b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:27.716180 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5c1b1326-a019-47f6-9d06-1dcd0c23a30b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:27.716953 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5c1b1326-a019-47f6-9d06-1dcd0c23a30b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:27.717386 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5c1b1326-a019-47f6-9d06-1dcd0c23a30b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:27.783234 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-5c1b1326-a019-47f6-9d06-1dcd0c23a30b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:27.792090 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5c1b1326-a019-47f6-9d06-1dcd0c23a30b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb" status: 200 len: 1210 microversion: 2.1 time: 0.088773 May 17 17:26:27.792764 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 248/553] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:27 2022] GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb => generated 1210 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:27.876421 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1b39a6ee-7510-4723-8f47-8989fe838ebd tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:27.877003 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1b39a6ee-7510-4723-8f47-8989fe838ebd tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:27.883241 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1b39a6ee-7510-4723-8f47-8989fe838ebd tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:27.883804 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1b39a6ee-7510-4723-8f47-8989fe838ebd tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:27.884568 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1b39a6ee-7510-4723-8f47-8989fe838ebd tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:27.884995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1b39a6ee-7510-4723-8f47-8989fe838ebd tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:28.092027 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1b39a6ee-7510-4723-8f47-8989fe838ebd tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:28.100164 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1b39a6ee-7510-4723-8f47-8989fe838ebd tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1735 microversion: 2.1 time: 0.227459 May 17 17:26:28.100753 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 306/554] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:27 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1735 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:28.809446 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-9077bfbc-5894-4763-9500-26b8a0f1d28f tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:28.810167 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-9077bfbc-5894-4763-9500-26b8a0f1d28f tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: d8ed82ef-aec7-43db-9bc8-7f925f7e75cb] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:28.816526 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9077bfbc-5894-4763-9500-26b8a0f1d28f tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:28.821212 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9077bfbc-5894-4763-9500-26b8a0f1d28f tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:28.821212 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9077bfbc-5894-4763-9500-26b8a0f1d28f tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:28.821212 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9077bfbc-5894-4763-9500-26b8a0f1d28f tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:29.042543 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-9077bfbc-5894-4763-9500-26b8a0f1d28f tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:29.050190 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-9077bfbc-5894-4763-9500-26b8a0f1d28f tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb" status: 200 len: 1276 microversion: 2.1 time: 0.245194 May 17 17:26:29.050772 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 249/555] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:28 2022] GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb => generated 1276 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:29.117940 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7af1ba24-c01b-40df-9949-1f6f6876d468 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:29.118607 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-7af1ba24-c01b-40df-9949-1f6f6876d468 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:29.124397 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7af1ba24-c01b-40df-9949-1f6f6876d468 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:29.124906 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7af1ba24-c01b-40df-9949-1f6f6876d468 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:29.125675 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7af1ba24-c01b-40df-9949-1f6f6876d468 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:29.126112 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7af1ba24-c01b-40df-9949-1f6f6876d468 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:29.252238 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7af1ba24-c01b-40df-9949-1f6f6876d468 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:29.260396 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7af1ba24-c01b-40df-9949-1f6f6876d468 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1735 microversion: 2.1 time: 0.146386 May 17 17:26:29.260954 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 307/556] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:29 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:29.311993 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-cbdd6c22-0ae2-4c45-8eb0-6b34e2240150 req-70445bb1-0bb3-4ebd-a122-322c9852ecb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8ed82ef-aec7-43db-9bc8-7f925f7e75cb", "tag": "8245b756-0439-403f-a461-14dec64e2814"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:26:29.320805 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-cbdd6c22-0ae2-4c45-8eb0-6b34e2240150 req-70445bb1-0bb3-4ebd-a122-322c9852ecb4 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:29.321275 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-cbdd6c22-0ae2-4c45-8eb0-6b34e2240150 req-70445bb1-0bb3-4ebd-a122-322c9852ecb4 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:29.333283 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-cbdd6c22-0ae2-4c45-8eb0-6b34e2240150 req-70445bb1-0bb3-4ebd-a122-322c9852ecb4 service nova] Creating event network-changed:8245b756-0439-403f-a461-14dec64e2814 for instance d8ed82ef-aec7-43db-9bc8-7f925f7e75cb on hv-cinder-84214 May 17 17:26:29.338182 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-cbdd6c22-0ae2-4c45-8eb0-6b34e2240150 req-70445bb1-0bb3-4ebd-a122-322c9852ecb4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031144 May 17 17:26:29.338776 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 250/557] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:26:30.066791 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-44b13137-d10e-4c89-bb7d-31d8f8091e68 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:30.067480 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-44b13137-d10e-4c89-bb7d-31d8f8091e68 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: d8ed82ef-aec7-43db-9bc8-7f925f7e75cb] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:30.074216 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-44b13137-d10e-4c89-bb7d-31d8f8091e68 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:30.075198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-44b13137-d10e-4c89-bb7d-31d8f8091e68 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:30.075533 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-44b13137-d10e-4c89-bb7d-31d8f8091e68 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:30.075993 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-44b13137-d10e-4c89-bb7d-31d8f8091e68 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:30.205225 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-44b13137-d10e-4c89-bb7d-31d8f8091e68 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:30.212979 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-44b13137-d10e-4c89-bb7d-31d8f8091e68 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb" status: 200 len: 1264 microversion: 2.1 time: 0.150126 May 17 17:26:30.213534 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 308/558] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:30 2022] GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:30.278406 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7d227e63-8ee1-4ea9-97e8-04f55e2cd0db tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:30.279029 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-7d227e63-8ee1-4ea9-97e8-04f55e2cd0db tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:30.285323 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7d227e63-8ee1-4ea9-97e8-04f55e2cd0db tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:30.285838 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7d227e63-8ee1-4ea9-97e8-04f55e2cd0db tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:30.287133 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7d227e63-8ee1-4ea9-97e8-04f55e2cd0db tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:30.287591 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7d227e63-8ee1-4ea9-97e8-04f55e2cd0db tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:30.412562 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7d227e63-8ee1-4ea9-97e8-04f55e2cd0db tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:30.420373 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-7d227e63-8ee1-4ea9-97e8-04f55e2cd0db tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1735 microversion: 2.1 time: 0.146682 May 17 17:26:30.420942 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 251/559] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:30 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:31.229828 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5128bb78-14dd-4f24-ac97-f891ce40caa3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:31.230436 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5128bb78-14dd-4f24-ac97-f891ce40caa3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: d8ed82ef-aec7-43db-9bc8-7f925f7e75cb] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:31.236351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5128bb78-14dd-4f24-ac97-f891ce40caa3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:31.236810 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5128bb78-14dd-4f24-ac97-f891ce40caa3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:31.237578 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5128bb78-14dd-4f24-ac97-f891ce40caa3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:31.238016 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5128bb78-14dd-4f24-ac97-f891ce40caa3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:31.364832 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5128bb78-14dd-4f24-ac97-f891ce40caa3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:31.372201 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5128bb78-14dd-4f24-ac97-f891ce40caa3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb" status: 200 len: 1264 microversion: 2.1 time: 0.146264 May 17 17:26:31.372764 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 309/560] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:31 2022] GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:31.437821 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a6dec5eb-53c3-43c7-92cb-db94977f9a99 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:31.438420 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a6dec5eb-53c3-43c7-92cb-db94977f9a99 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:31.444690 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a6dec5eb-53c3-43c7-92cb-db94977f9a99 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:31.445153 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a6dec5eb-53c3-43c7-92cb-db94977f9a99 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:31.445888 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a6dec5eb-53c3-43c7-92cb-db94977f9a99 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:31.446315 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a6dec5eb-53c3-43c7-92cb-db94977f9a99 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:31.574075 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a6dec5eb-53c3-43c7-92cb-db94977f9a99 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:31.581680 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a6dec5eb-53c3-43c7-92cb-db94977f9a99 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1735 microversion: 2.1 time: 0.147688 May 17 17:26:31.582242 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 252/561] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:31 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:32.388725 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c1a90db4-ab55-4f45-829e-7ccaae395ad3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:32.389328 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c1a90db4-ab55-4f45-829e-7ccaae395ad3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: d8ed82ef-aec7-43db-9bc8-7f925f7e75cb] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:32.395788 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c1a90db4-ab55-4f45-829e-7ccaae395ad3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:32.396232 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c1a90db4-ab55-4f45-829e-7ccaae395ad3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:32.396983 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c1a90db4-ab55-4f45-829e-7ccaae395ad3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:32.397411 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c1a90db4-ab55-4f45-829e-7ccaae395ad3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:32.523787 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c1a90db4-ab55-4f45-829e-7ccaae395ad3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:32.530890 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c1a90db4-ab55-4f45-829e-7ccaae395ad3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb" status: 200 len: 1264 microversion: 2.1 time: 0.145998 May 17 17:26:32.531441 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 310/562] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:32 2022] GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:32.598969 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f51fe584-a387-467c-8659-f53b022caef6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:32.599602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f51fe584-a387-467c-8659-f53b022caef6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:32.605868 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f51fe584-a387-467c-8659-f53b022caef6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:32.606318 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f51fe584-a387-467c-8659-f53b022caef6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:32.607080 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f51fe584-a387-467c-8659-f53b022caef6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:32.607539 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f51fe584-a387-467c-8659-f53b022caef6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:32.734207 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f51fe584-a387-467c-8659-f53b022caef6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:32.742525 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f51fe584-a387-467c-8659-f53b022caef6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1735 microversion: 2.1 time: 0.147379 May 17 17:26:32.743090 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 253/563] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:32 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:33.548357 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2abe5614-8e63-41ee-a998-242f55bd6900 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:33.549045 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2abe5614-8e63-41ee-a998-242f55bd6900 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: d8ed82ef-aec7-43db-9bc8-7f925f7e75cb] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:33.554854 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2abe5614-8e63-41ee-a998-242f55bd6900 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:33.555306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2abe5614-8e63-41ee-a998-242f55bd6900 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:33.556245 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2abe5614-8e63-41ee-a998-242f55bd6900 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:33.556683 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2abe5614-8e63-41ee-a998-242f55bd6900 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:33.688914 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2abe5614-8e63-41ee-a998-242f55bd6900 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:33.696652 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2abe5614-8e63-41ee-a998-242f55bd6900 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb" status: 200 len: 1264 microversion: 2.1 time: 0.152128 May 17 17:26:33.697216 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 311/564] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:33 2022] GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:33.759880 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7c573f95-7196-4513-866f-ac493341a56b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:33.760434 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-7c573f95-7196-4513-866f-ac493341a56b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:33.766651 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7c573f95-7196-4513-866f-ac493341a56b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:33.767100 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7c573f95-7196-4513-866f-ac493341a56b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:33.767886 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7c573f95-7196-4513-866f-ac493341a56b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:33.768320 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7c573f95-7196-4513-866f-ac493341a56b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:33.893200 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7c573f95-7196-4513-866f-ac493341a56b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:33.901426 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-7c573f95-7196-4513-866f-ac493341a56b tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1735 microversion: 2.1 time: 0.145481 May 17 17:26:33.901987 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 254/565] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:33 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:34.712563 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-cf44cdac-527c-4496-a941-4eb4d9900bd5 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:34.713167 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-cf44cdac-527c-4496-a941-4eb4d9900bd5 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: d8ed82ef-aec7-43db-9bc8-7f925f7e75cb] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:34.718984 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cf44cdac-527c-4496-a941-4eb4d9900bd5 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:34.719428 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cf44cdac-527c-4496-a941-4eb4d9900bd5 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:34.720214 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cf44cdac-527c-4496-a941-4eb4d9900bd5 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:34.720644 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cf44cdac-527c-4496-a941-4eb4d9900bd5 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:34.847307 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-cf44cdac-527c-4496-a941-4eb4d9900bd5 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:34.854404 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-cf44cdac-527c-4496-a941-4eb4d9900bd5 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb" status: 200 len: 1264 microversion: 2.1 time: 0.145653 May 17 17:26:34.854958 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 312/566] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:34 2022] GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:34.917968 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3d6d403d-c5fd-453e-a7c2-d6395b86ca0e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:34.918578 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3d6d403d-c5fd-453e-a7c2-d6395b86ca0e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:34.924885 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3d6d403d-c5fd-453e-a7c2-d6395b86ca0e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:34.925329 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3d6d403d-c5fd-453e-a7c2-d6395b86ca0e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:34.926578 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3d6d403d-c5fd-453e-a7c2-d6395b86ca0e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:34.927013 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3d6d403d-c5fd-453e-a7c2-d6395b86ca0e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:35.049926 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3d6d403d-c5fd-453e-a7c2-d6395b86ca0e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:35.058353 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3d6d403d-c5fd-453e-a7c2-d6395b86ca0e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1735 microversion: 2.1 time: 0.144162 May 17 17:26:35.058913 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 255/567] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:34 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:35.872015 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f1ca02c1-bd5c-4255-9d16-4c714d8fd5f7 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:35.872574 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f1ca02c1-bd5c-4255-9d16-4c714d8fd5f7 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: d8ed82ef-aec7-43db-9bc8-7f925f7e75cb] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:35.878607 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f1ca02c1-bd5c-4255-9d16-4c714d8fd5f7 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:35.879057 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f1ca02c1-bd5c-4255-9d16-4c714d8fd5f7 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:35.879839 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f1ca02c1-bd5c-4255-9d16-4c714d8fd5f7 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:35.880274 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f1ca02c1-bd5c-4255-9d16-4c714d8fd5f7 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:36.006880 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f1ca02c1-bd5c-4255-9d16-4c714d8fd5f7 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:36.014035 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f1ca02c1-bd5c-4255-9d16-4c714d8fd5f7 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb" status: 200 len: 1264 microversion: 2.1 time: 0.145849 May 17 17:26:36.014614 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 313/568] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:35 2022] GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:36.075009 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-bb0df011-3859-4022-ab83-88515552f07f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:36.075634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-bb0df011-3859-4022-ab83-88515552f07f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:36.081843 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bb0df011-3859-4022-ab83-88515552f07f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:36.082332 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bb0df011-3859-4022-ab83-88515552f07f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:36.083089 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bb0df011-3859-4022-ab83-88515552f07f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:36.083537 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bb0df011-3859-4022-ab83-88515552f07f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:36.208924 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-bb0df011-3859-4022-ab83-88515552f07f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:36.216538 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-bb0df011-3859-4022-ab83-88515552f07f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1735 microversion: 2.1 time: 0.145271 May 17 17:26:36.217095 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 256/569] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:36 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:37.030103 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3890191c-41df-489f-947e-796f20feb3aa tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:37.030717 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3890191c-41df-489f-947e-796f20feb3aa tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: d8ed82ef-aec7-43db-9bc8-7f925f7e75cb] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:37.037494 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3890191c-41df-489f-947e-796f20feb3aa tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:37.037943 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3890191c-41df-489f-947e-796f20feb3aa tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:37.038704 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3890191c-41df-489f-947e-796f20feb3aa tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:37.039137 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3890191c-41df-489f-947e-796f20feb3aa tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:37.166892 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-3890191c-41df-489f-947e-796f20feb3aa tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:37.174081 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3890191c-41df-489f-947e-796f20feb3aa tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb" status: 200 len: 1264 microversion: 2.1 time: 0.147858 May 17 17:26:37.174634 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 314/570] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:37 2022] GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:37.243440 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-33cfb728-b1c1-49de-a8cf-29dd620ffebb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:37.244079 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-33cfb728-b1c1-49de-a8cf-29dd620ffebb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:37.250426 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-33cfb728-b1c1-49de-a8cf-29dd620ffebb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:37.250874 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-33cfb728-b1c1-49de-a8cf-29dd620ffebb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:37.251665 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-33cfb728-b1c1-49de-a8cf-29dd620ffebb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:37.252097 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-33cfb728-b1c1-49de-a8cf-29dd620ffebb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:37.376574 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-33cfb728-b1c1-49de-a8cf-29dd620ffebb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:37.384248 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-33cfb728-b1c1-49de-a8cf-29dd620ffebb tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1735 microversion: 2.1 time: 0.144715 May 17 17:26:37.384810 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 257/571] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:37 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:38.190671 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-fe559453-d3a3-49df-95d3-c2ae3eaffbeb tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:38.191306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-fe559453-d3a3-49df-95d3-c2ae3eaffbeb tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: d8ed82ef-aec7-43db-9bc8-7f925f7e75cb] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:38.197709 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fe559453-d3a3-49df-95d3-c2ae3eaffbeb tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:38.198153 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fe559453-d3a3-49df-95d3-c2ae3eaffbeb tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:38.198906 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fe559453-d3a3-49df-95d3-c2ae3eaffbeb tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:38.199333 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fe559453-d3a3-49df-95d3-c2ae3eaffbeb tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:38.327466 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-fe559453-d3a3-49df-95d3-c2ae3eaffbeb tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:38.335241 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-fe559453-d3a3-49df-95d3-c2ae3eaffbeb tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb" status: 200 len: 1264 microversion: 2.1 time: 0.148542 May 17 17:26:38.335826 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 315/572] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:38 2022] GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:38.400712 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-af0070db-c637-426c-b3b2-3b038d4e64c2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:38.401314 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-af0070db-c637-426c-b3b2-3b038d4e64c2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:38.407504 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-af0070db-c637-426c-b3b2-3b038d4e64c2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:38.407976 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-af0070db-c637-426c-b3b2-3b038d4e64c2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:38.408984 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-af0070db-c637-426c-b3b2-3b038d4e64c2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:38.409419 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-af0070db-c637-426c-b3b2-3b038d4e64c2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:38.533380 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-af0070db-c637-426c-b3b2-3b038d4e64c2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:38.542023 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-af0070db-c637-426c-b3b2-3b038d4e64c2 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1735 microversion: 2.1 time: 0.145131 May 17 17:26:38.542599 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 258/573] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:38 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:39.351453 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-892dfe26-a2d1-4430-a009-142ef4195cb6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:39.352110 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-892dfe26-a2d1-4430-a009-142ef4195cb6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: d8ed82ef-aec7-43db-9bc8-7f925f7e75cb] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:39.358070 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-892dfe26-a2d1-4430-a009-142ef4195cb6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:39.358467 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-892dfe26-a2d1-4430-a009-142ef4195cb6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:39.359235 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-892dfe26-a2d1-4430-a009-142ef4195cb6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:39.359705 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-892dfe26-a2d1-4430-a009-142ef4195cb6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:39.489327 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-892dfe26-a2d1-4430-a009-142ef4195cb6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:39.496658 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-892dfe26-a2d1-4430-a009-142ef4195cb6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb" status: 200 len: 1264 microversion: 2.1 time: 0.149681 May 17 17:26:39.497205 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 316/574] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:39 2022] GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:39.558151 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a16b6530-6c83-4628-91cf-669f256fe8c9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:39.558754 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a16b6530-6c83-4628-91cf-669f256fe8c9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:39.565121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a16b6530-6c83-4628-91cf-669f256fe8c9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:39.565564 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a16b6530-6c83-4628-91cf-669f256fe8c9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:39.566318 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a16b6530-6c83-4628-91cf-669f256fe8c9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:39.567257 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a16b6530-6c83-4628-91cf-669f256fe8c9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:39.697208 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a16b6530-6c83-4628-91cf-669f256fe8c9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:39.705096 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a16b6530-6c83-4628-91cf-669f256fe8c9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1735 microversion: 2.1 time: 0.150791 May 17 17:26:39.705676 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 259/575] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:39 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:40.513669 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e5e7086b-33cb-444a-896c-eab06c2000d4 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:40.514280 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e5e7086b-33cb-444a-896c-eab06c2000d4 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: d8ed82ef-aec7-43db-9bc8-7f925f7e75cb] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:40.520800 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e5e7086b-33cb-444a-896c-eab06c2000d4 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:40.521252 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e5e7086b-33cb-444a-896c-eab06c2000d4 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:40.522012 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e5e7086b-33cb-444a-896c-eab06c2000d4 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:40.522448 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e5e7086b-33cb-444a-896c-eab06c2000d4 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:40.650953 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e5e7086b-33cb-444a-896c-eab06c2000d4 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:40.658299 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e5e7086b-33cb-444a-896c-eab06c2000d4 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb" status: 200 len: 1264 microversion: 2.1 time: 0.148451 May 17 17:26:40.659331 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 317/576] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:40 2022] GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:40.722261 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-61f9f678-fd31-47cf-9c36-c33f3add0300 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:40.723411 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-61f9f678-fd31-47cf-9c36-c33f3add0300 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:40.729766 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-61f9f678-fd31-47cf-9c36-c33f3add0300 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:40.730260 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-61f9f678-fd31-47cf-9c36-c33f3add0300 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:40.730975 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-61f9f678-fd31-47cf-9c36-c33f3add0300 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:40.731415 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-61f9f678-fd31-47cf-9c36-c33f3add0300 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:40.761992 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-9b1eefb1-1359-4e70-b973-c429e52febc6 req-283f9aa3-c973-4396-8716-525d16f8f2b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8ed82ef-aec7-43db-9bc8-7f925f7e75cb", "name": "network-vif-plugged", "status": "completed", "tag": "8245b756-0439-403f-a461-14dec64e2814"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:26:40.770821 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-9b1eefb1-1359-4e70-b973-c429e52febc6 req-283f9aa3-c973-4396-8716-525d16f8f2b5 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:40.771334 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-9b1eefb1-1359-4e70-b973-c429e52febc6 req-283f9aa3-c973-4396-8716-525d16f8f2b5 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:40.783008 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-9b1eefb1-1359-4e70-b973-c429e52febc6 req-283f9aa3-c973-4396-8716-525d16f8f2b5 service nova] Creating event network-vif-plugged:8245b756-0439-403f-a461-14dec64e2814 for instance d8ed82ef-aec7-43db-9bc8-7f925f7e75cb on hv-cinder-84214 May 17 17:26:40.789459 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-9b1eefb1-1359-4e70-b973-c429e52febc6 req-283f9aa3-c973-4396-8716-525d16f8f2b5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031187 May 17 17:26:40.790149 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 318/577] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:26:40.867606 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-61f9f678-fd31-47cf-9c36-c33f3add0300 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:40.875317 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-61f9f678-fd31-47cf-9c36-c33f3add0300 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1715 microversion: 2.1 time: 0.157044 May 17 17:26:40.875993 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 260/578] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:40 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1715 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:40.978102 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-14461ed5-70d6-44d6-af08-d06b7ed5cfe6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:40.978685 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-14461ed5-70d6-44d6-af08-d06b7ed5cfe6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:40.984689 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-14461ed5-70d6-44d6-af08-d06b7ed5cfe6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:40.985140 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-14461ed5-70d6-44d6-af08-d06b7ed5cfe6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:40.986631 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-14461ed5-70d6-44d6-af08-d06b7ed5cfe6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:40.986631 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-14461ed5-70d6-44d6-af08-d06b7ed5cfe6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:41.063875 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-14461ed5-70d6-44d6-af08-d06b7ed5cfe6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] HTTP exception thrown: Cannot 'detach_volume' instance de553cb6-1884-4291-a670-74718d9705e0 while it is in vm_state rescued May 17 17:26:41.065472 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-14461ed5-70d6-44d6-af08-d06b7ed5cfe6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Request method failure captured: May 17 17:26:41.065472 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: request: DELETE /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0/os-volume_attachments/7ea9b902-e617-4332-92c7-65b139298d6a HTTP/1.1 May 17 17:26:41.065472 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 17 17:26:41.065472 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 17 17:26:41.065472 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Connection: close May 17 17:26:41.065472 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 17 17:26:41.065472 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 17 17:26:41.065472 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.88 May 17 17:26:41.065472 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 17 17:26:41.065472 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 17 17:26:41.065472 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABig9nCRi7Ba9wQiT8Z77JafySk8CdhUt_ec4kFMIRq6DJ0yX_by762ZReR6jSTE7KXCyjCidygrSXAWsVX8isiTVL587-vJGZ3qsfPn7-65abLAEk6QPzTaTbYhBW-eVDouiob09eQRF2fFsF4z6eAkOVL065D-HYqt2yjlfRzYvbvUJA May 17 17:26:41.065472 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 17 17:26:41.065472 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 17 17:26:41.065472 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 17 17:26:41.065472 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 17 17:26:41.065472 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 17 17:26:41.065472 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 17 17:26:41.065472 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Id: d2b0be03d2fd4baf84d7d0b462392cba May 17 17:26:41.065472 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-82631249 May 17 17:26:41.065472 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Role: reader,member May 17 17:26:41.065472 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Roles: reader,member May 17 17:26:41.067461 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d2b0be03d2fd4baf84d7d0b462392cba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/d2b0be03d2fd4baf84d7d0b462392cba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d2b0be03d2fd4baf84d7d0b462392cba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_d2b0be03d2fd4baf84d7d0b462392cba", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:26:41.067461 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-ServerRescueNegativeTestJSON-82631249 May 17 17:26:41.067461 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: d2b0be03d2fd4baf84d7d0b462392cba May 17 17:26:41.067461 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-82631249 May 17 17:26:41.067461 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User: tempest-ServerRescueNegativeTestJSON-82631249-project May 17 17:26:41.067461 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 17 17:26:41.067461 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 17 17:26:41.067461 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Id: 8ebdfee8d3d64c2696e9c5695cebdba3 May 17 17:26:41.067461 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-ServerRescueNegativeTestJSON-82631249-project May 17 17:26:41.067461 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: method: > May 17 17:26:41.067461 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: exception: Cannot 'detach_volume' instance de553cb6-1884-4291-a670-74718d9705e0 while it is in vm_state rescued May 17 17:26:41.071211 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: action_args: {'server_id': 'de553cb6-1884-4291-a670-74718d9705e0', 'id': '7ea9b902-e617-4332-92c7-65b139298d6a'} May 17 17:26:41.071211 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:26:41.071211 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:26:41.071211 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 17 17:26:41.071211 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 17 17:26:41.071211 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 17 17:26:41.071211 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 17 17:26:41.071211 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 17 17:26:41.071211 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 17 17:26:41.071211 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance de553cb6-1884-4291-a670-74718d9705e0 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 17 17:26:41.071211 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:26:41.071211 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:26:41.071211 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:26:41.071211 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:26:41.071211 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:26:41.071211 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:26:41.071211 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:26:41.071211 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:26:41.071211 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:26:41.071211 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:26:41.072806 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 17 17:26:41.072806 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 17 17:26:41.072806 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 17 17:26:41.072806 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 17 17:26:41.072806 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance de553cb6-1884-4291-a670-74718d9705e0 while it is in vm_state rescued May 17 17:26:41.072806 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:26:41.072806 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:26:41.072806 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:26:41.072806 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:26:41.072806 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:26:41.072806 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:26:41.072806 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:26:41.072806 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:26:41.072806 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance de553cb6-1884-4291-a670-74718d9705e0 while it is in vm_state rescued May 17 17:26:41.072806 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:26:41.072806 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-14461ed5-70d6-44d6-af08-d06b7ed5cfe6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Returning 409 to user: Cannot 'detach_volume' instance de553cb6-1884-4291-a670-74718d9705e0 while it is in vm_state rescued {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:26:41.074042 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-14461ed5-70d6-44d6-af08-d06b7ed5cfe6 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "DELETE /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0/os-volume_attachments/7ea9b902-e617-4332-92c7-65b139298d6a" status: 409 len: 152 microversion: 2.1 time: 0.093685 May 17 17:26:41.074042 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 319/579] 10.222.0.88 () {58 vars in 1415 bytes} [Tue May 17 17:26:40 2022] DELETE /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0/os-volume_attachments/7ea9b902-e617-4332-92c7-65b139298d6a => generated 152 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 17 17:26:41.076230 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b6a70a72-4cd8-4637-8b7e-7b2b53073220 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:26:41.076767 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b6a70a72-4cd8-4637-8b7e-7b2b53073220 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:41.083197 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b6a70a72-4cd8-4637-8b7e-7b2b53073220 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:41.083705 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b6a70a72-4cd8-4637-8b7e-7b2b53073220 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:41.084473 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b6a70a72-4cd8-4637-8b7e-7b2b53073220 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:41.084913 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b6a70a72-4cd8-4637-8b7e-7b2b53073220 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:41.284684 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b6a70a72-4cd8-4637-8b7e-7b2b53073220 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "POST /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0/action" status: 202 len: 0 microversion: 2.1 time: 0.211679 May 17 17:26:41.285777 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 261/580] 10.222.0.88 () {60 vars in 1277 bytes} [Tue May 17 17:26:41 2022] POST /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:26:41.293804 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-fd1afffa-ca70-457f-9548-a5b68a237551 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:41.294447 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-fd1afffa-ca70-457f-9548-a5b68a237551 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:41.301811 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fd1afffa-ca70-457f-9548-a5b68a237551 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:41.302264 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fd1afffa-ca70-457f-9548-a5b68a237551 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:41.303025 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fd1afffa-ca70-457f-9548-a5b68a237551 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:41.303491 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fd1afffa-ca70-457f-9548-a5b68a237551 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:41.432041 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-fd1afffa-ca70-457f-9548-a5b68a237551 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:41.439823 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-fd1afffa-ca70-457f-9548-a5b68a237551 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1723 microversion: 2.1 time: 0.149764 May 17 17:26:41.440401 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 320/581] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:41 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:41.676425 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5d487f1b-1694-4cd9-bcfb-519870ca7ae9 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:41.677110 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-5d487f1b-1694-4cd9-bcfb-519870ca7ae9 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: d8ed82ef-aec7-43db-9bc8-7f925f7e75cb] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:41.683261 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5d487f1b-1694-4cd9-bcfb-519870ca7ae9 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:41.683731 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5d487f1b-1694-4cd9-bcfb-519870ca7ae9 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:41.684546 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5d487f1b-1694-4cd9-bcfb-519870ca7ae9 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:41.684979 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5d487f1b-1694-4cd9-bcfb-519870ca7ae9 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:41.844417 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-5d487f1b-1694-4cd9-bcfb-519870ca7ae9 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:41.855362 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5d487f1b-1694-4cd9-bcfb-519870ca7ae9 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb" status: 200 len: 1264 microversion: 2.1 time: 0.182864 May 17 17:26:41.856328 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 262/582] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:41 2022] GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:42.458523 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8037c025-1068-40e6-b693-583c1d479cea tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:42.459080 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8037c025-1068-40e6-b693-583c1d479cea tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:42.465505 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8037c025-1068-40e6-b693-583c1d479cea tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:42.465807 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8037c025-1068-40e6-b693-583c1d479cea tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:42.466582 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8037c025-1068-40e6-b693-583c1d479cea tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:42.467023 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8037c025-1068-40e6-b693-583c1d479cea tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:42.596837 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8037c025-1068-40e6-b693-583c1d479cea tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:42.605376 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8037c025-1068-40e6-b693-583c1d479cea tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1723 microversion: 2.1 time: 0.151450 May 17 17:26:42.606019 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 321/583] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:42 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:42.872167 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-aac777cf-b466-4f2f-b1ae-f7141798b819 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:42.872708 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-aac777cf-b466-4f2f-b1ae-f7141798b819 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: d8ed82ef-aec7-43db-9bc8-7f925f7e75cb] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:42.880059 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-aac777cf-b466-4f2f-b1ae-f7141798b819 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:42.881167 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-aac777cf-b466-4f2f-b1ae-f7141798b819 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:42.882016 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-aac777cf-b466-4f2f-b1ae-f7141798b819 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:42.882463 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-aac777cf-b466-4f2f-b1ae-f7141798b819 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:43.010620 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-aac777cf-b466-4f2f-b1ae-f7141798b819 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:43.018017 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-aac777cf-b466-4f2f-b1ae-f7141798b819 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb" status: 200 len: 1264 microversion: 2.1 time: 0.150542 May 17 17:26:43.018573 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 263/584] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:42 2022] GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:43.622132 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-782618cf-db59-4c5f-9232-414f3f8cebe9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:43.622815 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-782618cf-db59-4c5f-9232-414f3f8cebe9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:43.628649 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-782618cf-db59-4c5f-9232-414f3f8cebe9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:43.629093 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-782618cf-db59-4c5f-9232-414f3f8cebe9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:43.629865 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-782618cf-db59-4c5f-9232-414f3f8cebe9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:43.630304 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-782618cf-db59-4c5f-9232-414f3f8cebe9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:43.755258 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-782618cf-db59-4c5f-9232-414f3f8cebe9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:43.762970 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-782618cf-db59-4c5f-9232-414f3f8cebe9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1723 microversion: 2.1 time: 0.144643 May 17 17:26:43.763565 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 322/585] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:43 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:44.035086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4f7d7af2-c29a-43f8-85c4-a160090b30fa tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:44.036258 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4f7d7af2-c29a-43f8-85c4-a160090b30fa tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: d8ed82ef-aec7-43db-9bc8-7f925f7e75cb] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:44.042513 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4f7d7af2-c29a-43f8-85c4-a160090b30fa tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:44.042956 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4f7d7af2-c29a-43f8-85c4-a160090b30fa tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:44.043769 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4f7d7af2-c29a-43f8-85c4-a160090b30fa tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:44.044203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4f7d7af2-c29a-43f8-85c4-a160090b30fa tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:44.070577 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-9cc73032-c4f3-4ff8-87f0-06d542975b23 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:44.071060 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-9cc73032-c4f3-4ff8-87f0-06d542975b23 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:44.076890 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9cc73032-c4f3-4ff8-87f0-06d542975b23 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:44.077332 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9cc73032-c4f3-4ff8-87f0-06d542975b23 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:44.078088 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9cc73032-c4f3-4ff8-87f0-06d542975b23 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:44.078516 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9cc73032-c4f3-4ff8-87f0-06d542975b23 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:44.107380 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-9cc73032-c4f3-4ff8-87f0-06d542975b23 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44/os-volume_attachments/92e329e7-7df9-4687-abeb-c7c82530dc90" status: 200 len: 194 microversion: 2.20 time: 0.040714 May 17 17:26:44.108005 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 323/586] 10.222.0.88 () {60 vars in 1453 bytes} [Tue May 17 17:26:44 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44/os-volume_attachments/92e329e7-7df9-4687-abeb-c7c82530dc90 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 17:26:44.169265 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-466b0482-72dd-41c5-ac67-1f3c66c0f94b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:44.169837 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-466b0482-72dd-41c5-ac67-1f3c66c0f94b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:44.175369 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4f7d7af2-c29a-43f8-85c4-a160090b30fa tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:44.176120 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-466b0482-72dd-41c5-ac67-1f3c66c0f94b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:44.176909 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-466b0482-72dd-41c5-ac67-1f3c66c0f94b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:44.178071 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-466b0482-72dd-41c5-ac67-1f3c66c0f94b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:44.178627 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-466b0482-72dd-41c5-ac67-1f3c66c0f94b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:44.182894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4f7d7af2-c29a-43f8-85c4-a160090b30fa tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb" status: 200 len: 1451 microversion: 2.1 time: 0.151849 May 17 17:26:44.183473 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 264/587] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:44 2022] GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:44.199031 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6c39738d-017d-4e9c-a835-d48fe1bd4c83 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:44.199670 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6c39738d-017d-4e9c-a835-d48fe1bd4c83 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: d8ed82ef-aec7-43db-9bc8-7f925f7e75cb] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:44.205453 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6c39738d-017d-4e9c-a835-d48fe1bd4c83 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:44.205904 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6c39738d-017d-4e9c-a835-d48fe1bd4c83 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:44.206672 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6c39738d-017d-4e9c-a835-d48fe1bd4c83 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:44.207826 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6c39738d-017d-4e9c-a835-d48fe1bd4c83 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:44.256379 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-466b0482-72dd-41c5-ac67-1f3c66c0f94b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lazy-loading 'services' on Instance uuid bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:26:44.335333 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6c39738d-017d-4e9c-a835-d48fe1bd4c83 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:44.342621 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6c39738d-017d-4e9c-a835-d48fe1bd4c83 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb" status: 200 len: 1451 microversion: 2.1 time: 0.147231 May 17 17:26:44.343184 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 265/588] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:44 2022] GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:26:44.485461 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-466b0482-72dd-41c5-ac67-1f3c66c0f94b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "DELETE /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44/os-volume_attachments/92e329e7-7df9-4687-abeb-c7c82530dc90" status: 202 len: 0 microversion: 2.20 time: 0.319975 May 17 17:26:44.486316 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 324/589] 10.222.0.88 () {60 vars in 1456 bytes} [Tue May 17 17:26:44 2022] DELETE /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44/os-volume_attachments/92e329e7-7df9-4687-abeb-c7c82530dc90 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 17 17:26:44.495119 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a62de608-e3f6-4cdf-80b7-cb84eeaecbc5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:44.498660 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a62de608-e3f6-4cdf-80b7-cb84eeaecbc5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:44.501998 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a62de608-e3f6-4cdf-80b7-cb84eeaecbc5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:44.502512 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a62de608-e3f6-4cdf-80b7-cb84eeaecbc5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:44.503346 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a62de608-e3f6-4cdf-80b7-cb84eeaecbc5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:44.503868 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a62de608-e3f6-4cdf-80b7-cb84eeaecbc5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:44.534243 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a62de608-e3f6-4cdf-80b7-cb84eeaecbc5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042902 May 17 17:26:44.534899 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 266/590] 10.222.0.88 () {60 vars in 1342 bytes} [Tue May 17 17:26:44 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 17:26:44.781111 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-10fb4b96-5393-42fa-b6df-3c482f8cf0d4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:44.781808 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-10fb4b96-5393-42fa-b6df-3c482f8cf0d4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:44.788167 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-10fb4b96-5393-42fa-b6df-3c482f8cf0d4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:44.788619 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-10fb4b96-5393-42fa-b6df-3c482f8cf0d4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:44.789385 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-10fb4b96-5393-42fa-b6df-3c482f8cf0d4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:44.789818 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-10fb4b96-5393-42fa-b6df-3c482f8cf0d4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:44.920489 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-10fb4b96-5393-42fa-b6df-3c482f8cf0d4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:44.928447 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-10fb4b96-5393-42fa-b6df-3c482f8cf0d4 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1723 microversion: 2.1 time: 0.151530 May 17 17:26:44.929010 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 325/591] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:44 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:45.546053 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d6762f1f-9c56-483f-b492-e843974a1483 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:45.547059 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d6762f1f-9c56-483f-b492-e843974a1483 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:45.553537 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d6762f1f-9c56-483f-b492-e843974a1483 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:45.554898 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d6762f1f-9c56-483f-b492-e843974a1483 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:45.555708 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d6762f1f-9c56-483f-b492-e843974a1483 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:45.556141 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d6762f1f-9c56-483f-b492-e843974a1483 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:45.585691 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d6762f1f-9c56-483f-b492-e843974a1483 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043535 May 17 17:26:45.586493 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 267/592] 10.222.0.88 () {60 vars in 1342 bytes} [Tue May 17 17:26:45 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 17:26:45.945541 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-bf0c04f8-cbc6-43ba-adb3-e1394bab7a95 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:45.946416 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-bf0c04f8-cbc6-43ba-adb3-e1394bab7a95 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:45.952156 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bf0c04f8-cbc6-43ba-adb3-e1394bab7a95 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:45.952599 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bf0c04f8-cbc6-43ba-adb3-e1394bab7a95 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:45.953354 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bf0c04f8-cbc6-43ba-adb3-e1394bab7a95 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:45.953782 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bf0c04f8-cbc6-43ba-adb3-e1394bab7a95 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:46.087965 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-bf0c04f8-cbc6-43ba-adb3-e1394bab7a95 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:46.095916 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-bf0c04f8-cbc6-43ba-adb3-e1394bab7a95 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1729 microversion: 2.1 time: 0.154053 May 17 17:26:46.096687 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 326/593] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:45 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:46.119280 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-34a1e71e-759e-4d2a-a789-5b9cd9a7e978 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:46.120030 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-34a1e71e-759e-4d2a-a789-5b9cd9a7e978 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:46.126114 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-34a1e71e-759e-4d2a-a789-5b9cd9a7e978 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:46.126564 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-34a1e71e-759e-4d2a-a789-5b9cd9a7e978 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:46.127343 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-34a1e71e-759e-4d2a-a789-5b9cd9a7e978 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:46.127866 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-34a1e71e-759e-4d2a-a789-5b9cd9a7e978 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:46.206091 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-34a1e71e-759e-4d2a-a789-5b9cd9a7e978 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090544 May 17 17:26:46.206896 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 268/594] 10.222.0.88 () {58 vars in 1274 bytes} [Tue May 17 17:26:46 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:26:46.436572 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-5d6c6675-6fe2-4b21-9b30-3034a013fe29 req-18824c64-631a-469b-aef6-9d31b65b0d2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8ed82ef-aec7-43db-9bc8-7f925f7e75cb", "tag": "8245b756-0439-403f-a461-14dec64e2814"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:26:46.445574 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-5d6c6675-6fe2-4b21-9b30-3034a013fe29 req-18824c64-631a-469b-aef6-9d31b65b0d2b service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:46.446153 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-5d6c6675-6fe2-4b21-9b30-3034a013fe29 req-18824c64-631a-469b-aef6-9d31b65b0d2b service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:46.457328 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-5d6c6675-6fe2-4b21-9b30-3034a013fe29 req-18824c64-631a-469b-aef6-9d31b65b0d2b service nova] Creating event network-changed:8245b756-0439-403f-a461-14dec64e2814 for instance d8ed82ef-aec7-43db-9bc8-7f925f7e75cb on hv-cinder-84214 May 17 17:26:46.462186 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-5d6c6675-6fe2-4b21-9b30-3034a013fe29 req-18824c64-631a-469b-aef6-9d31b65b0d2b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029357 May 17 17:26:46.463020 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 327/595] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:26:46.598589 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-71ea3318-7927-4fba-adf6-bb38a40be00a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:46.599591 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-71ea3318-7927-4fba-adf6-bb38a40be00a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:46.611555 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-71ea3318-7927-4fba-adf6-bb38a40be00a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:46.612009 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-71ea3318-7927-4fba-adf6-bb38a40be00a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:46.612808 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-71ea3318-7927-4fba-adf6-bb38a40be00a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:46.613287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-71ea3318-7927-4fba-adf6-bb38a40be00a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:46.650795 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-71ea3318-7927-4fba-adf6-bb38a40be00a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057118 May 17 17:26:46.651494 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 269/596] 10.222.0.88 () {60 vars in 1342 bytes} [Tue May 17 17:26:46 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:46.716163 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d730d945-8ebf-48b3-9eea-fd042e41e2f9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:46.716736 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d730d945-8ebf-48b3-9eea-fd042e41e2f9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:46.723545 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d730d945-8ebf-48b3-9eea-fd042e41e2f9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:46.723997 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d730d945-8ebf-48b3-9eea-fd042e41e2f9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:46.724762 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d730d945-8ebf-48b3-9eea-fd042e41e2f9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:46.725370 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d730d945-8ebf-48b3-9eea-fd042e41e2f9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:46.752379 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d730d945-8ebf-48b3-9eea-fd042e41e2f9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Going to try to terminate instance {{(pid=117612) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:26:47.076238 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d730d945-8ebf-48b3-9eea-fd042e41e2f9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "DELETE /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 204 len: 0 microversion: 2.20 time: 0.363705 May 17 17:26:47.077702 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 328/597] 10.222.0.88 () {60 vars in 1279 bytes} [Tue May 17 17:26:46 2022] DELETE /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 17 17:26:47.086103 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7bbde2d6-ca98-431a-ad7a-16d9fa008e66 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:47.086710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-7bbde2d6-ca98-431a-ad7a-16d9fa008e66 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:47.094121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7bbde2d6-ca98-431a-ad7a-16d9fa008e66 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:47.094701 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7bbde2d6-ca98-431a-ad7a-16d9fa008e66 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:47.095759 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7bbde2d6-ca98-431a-ad7a-16d9fa008e66 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:47.096237 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7bbde2d6-ca98-431a-ad7a-16d9fa008e66 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:47.280423 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7bbde2d6-ca98-431a-ad7a-16d9fa008e66 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:47.290187 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7bbde2d6-ca98-431a-ad7a-16d9fa008e66 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:47.291819 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7bbde2d6-ca98-431a-ad7a-16d9fa008e66 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:47.293065 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-7bbde2d6-ca98-431a-ad7a-16d9fa008e66 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1723 microversion: 2.20 time: 0.210843 May 17 17:26:47.293850 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 270/598] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:26:47 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:26:47.575811 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-64a143c9-a289-437b-8332-a1011603cd61 req-a00327c3-f656-4533-bd7f-50a61b48c0b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de553cb6-1884-4291-a670-74718d9705e0", "tag": "917f3696-6eaa-402a-9e6a-03c0b7b05692"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:26:47.585537 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-64a143c9-a289-437b-8332-a1011603cd61 req-a00327c3-f656-4533-bd7f-50a61b48c0b0 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:47.585977 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-64a143c9-a289-437b-8332-a1011603cd61 req-a00327c3-f656-4533-bd7f-50a61b48c0b0 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:47.599376 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-64a143c9-a289-437b-8332-a1011603cd61 req-a00327c3-f656-4533-bd7f-50a61b48c0b0 service nova] Creating event network-changed:917f3696-6eaa-402a-9e6a-03c0b7b05692 for instance de553cb6-1884-4291-a670-74718d9705e0 on hv-cinder-84214 May 17 17:26:47.604562 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-64a143c9-a289-437b-8332-a1011603cd61 req-a00327c3-f656-4533-bd7f-50a61b48c0b0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032767 May 17 17:26:47.605151 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 329/599] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:26:48.311170 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7d4e2085-c675-4e90-8454-102b8c0cff59 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:48.311818 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-7d4e2085-c675-4e90-8454-102b8c0cff59 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:48.319125 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7d4e2085-c675-4e90-8454-102b8c0cff59 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:48.319648 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7d4e2085-c675-4e90-8454-102b8c0cff59 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:48.320419 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7d4e2085-c675-4e90-8454-102b8c0cff59 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:48.320856 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7d4e2085-c675-4e90-8454-102b8c0cff59 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:48.522016 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7d4e2085-c675-4e90-8454-102b8c0cff59 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:48.529801 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7d4e2085-c675-4e90-8454-102b8c0cff59 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:48.531297 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7d4e2085-c675-4e90-8454-102b8c0cff59 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:48.534136 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-7d4e2085-c675-4e90-8454-102b8c0cff59 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1723 microversion: 2.20 time: 0.225259 May 17 17:26:48.534136 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 271/600] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:26:48 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:26:49.553213 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-519d76d3-5983-4f42-a04f-09e0bfb45ffa tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:49.553825 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-519d76d3-5983-4f42-a04f-09e0bfb45ffa tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:49.559903 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-519d76d3-5983-4f42-a04f-09e0bfb45ffa tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:49.565459 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-519d76d3-5983-4f42-a04f-09e0bfb45ffa tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:49.565459 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-519d76d3-5983-4f42-a04f-09e0bfb45ffa tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:49.565459 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-519d76d3-5983-4f42-a04f-09e0bfb45ffa tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:49.638604 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-03b60eff-c094-4f87-95eb-483b2bcdda39 req-1903ad0f-1f98-473b-8731-f94944558a87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de553cb6-1884-4291-a670-74718d9705e0", "tag": "917f3696-6eaa-402a-9e6a-03c0b7b05692"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:26:49.639191 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-519d76d3-5983-4f42-a04f-09e0bfb45ffa tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:49.647726 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-519d76d3-5983-4f42-a04f-09e0bfb45ffa tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:49.648921 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-03b60eff-c094-4f87-95eb-483b2bcdda39 req-1903ad0f-1f98-473b-8731-f94944558a87 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:49.649354 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-519d76d3-5983-4f42-a04f-09e0bfb45ffa tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:49.649475 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-03b60eff-c094-4f87-95eb-483b2bcdda39 req-1903ad0f-1f98-473b-8731-f94944558a87 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:49.650529 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-519d76d3-5983-4f42-a04f-09e0bfb45ffa tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 200 len: 1657 microversion: 2.20 time: 0.102617 May 17 17:26:49.651076 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 330/601] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:26:49 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 1657 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:26:49.664393 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-03b60eff-c094-4f87-95eb-483b2bcdda39 req-1903ad0f-1f98-473b-8731-f94944558a87 service nova] Creating event network-changed:917f3696-6eaa-402a-9e6a-03c0b7b05692 for instance de553cb6-1884-4291-a670-74718d9705e0 on hv-cinder-84214 May 17 17:26:49.669821 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-03b60eff-c094-4f87-95eb-483b2bcdda39 req-1903ad0f-1f98-473b-8731-f94944558a87 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038981 May 17 17:26:49.670693 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 272/602] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:26:49.891950 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-8e4c49ea-7f75-42dc-b820-8abf1b3c262c req-504e7760-4188-496e-b6ca-088af9a51252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44", "name": "network-vif-deleted", "tag": "88984695-6cd9-4b4c-b02c-9f8d26d785d7"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:26:49.901541 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-8e4c49ea-7f75-42dc-b820-8abf1b3c262c req-504e7760-4188-496e-b6ca-088af9a51252 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:49.913565 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-8e4c49ea-7f75-42dc-b820-8abf1b3c262c req-504e7760-4188-496e-b6ca-088af9a51252 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:49.913565 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-8e4c49ea-7f75-42dc-b820-8abf1b3c262c req-504e7760-4188-496e-b6ca-088af9a51252 service nova] Creating event network-vif-deleted:88984695-6cd9-4b4c-b02c-9f8d26d785d7 for instance bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 on hv-cinder-84214 May 17 17:26:49.918247 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-8e4c49ea-7f75-42dc-b820-8abf1b3c262c req-504e7760-4188-496e-b6ca-088af9a51252 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029789 May 17 17:26:49.918876 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 331/603] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:26:50.670864 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8aad1d98-c9f4-4136-8898-3fe9881f70bb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:50.671973 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8aad1d98-c9f4-4136-8898-3fe9881f70bb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:50.678732 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8aad1d98-c9f4-4136-8898-3fe9881f70bb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:50.679329 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8aad1d98-c9f4-4136-8898-3fe9881f70bb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:50.680210 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8aad1d98-c9f4-4136-8898-3fe9881f70bb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:50.680712 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8aad1d98-c9f4-4136-8898-3fe9881f70bb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:50.694375 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-8aad1d98-c9f4-4136-8898-3fe9881f70bb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] HTTP exception thrown: Instance bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 could not be found. May 17 17:26:50.696143 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8aad1d98-c9f4-4136-8898-3fe9881f70bb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Request method failure captured: May 17 17:26:50.696143 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 HTTP/1.1 May 17 17:26:50.696143 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:26:50.696143 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:26:50.696143 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:26:50.696143 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:26:50.696143 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:26:50.696143 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:26:50.696143 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:26:50.696143 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:26:50.696143 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9nB1u3VZxRBW4qiid6zfFnMppvMGcutqckgTWhIekYL5_z6ELw3rZ_Ot4qeHDSK2aYicgR0Zzp-jRo2FFkFWut5usmQybdjLoz0yEb9hNIxY1fK9I36uRLakCGm5QG71BnddDxCsyBhCe4rlW0CvKKqOtKk8JxyGI3Qsnw4EsyL_wA May 17 17:26:50.696143 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:26:50.696143 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:26:50.696143 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:26:50.696143 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:26:50.696143 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Openstack-Nova-Api-Version: 2.20 May 17 17:26:50.696143 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:26:50.696143 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:26:50.696143 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: 649dd5d80f4142289f94ccd21ab4d68f May 17 17:26:50.696143 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1654364309 May 17 17:26:50.696143 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:26:50.696143 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:26:50.697599 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/649dd5d80f4142289f94ccd21ab4d68f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/649dd5d80f4142289f94ccd21ab4d68f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/649dd5d80f4142289f94ccd21ab4d68f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_649dd5d80f4142289f94ccd21ab4d68f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:26:50.697599 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1654364309 May 17 17:26:50.697599 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: 649dd5d80f4142289f94ccd21ab4d68f May 17 17:26:50.697599 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1654364309 May 17 17:26:50.697599 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-AttachVolumeShelveTestJSON-1654364309-project May 17 17:26:50.697599 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:26:50.697599 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:26:50.697599 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 49df2bc670324cd088691b8d20fcedab May 17 17:26:50.697599 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1654364309-project May 17 17:26:50.697599 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:26:50.697599 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Instance bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 could not be found. May 17 17:26:50.697599 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': 'bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44'} May 17 17:26:50.698828 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:26:50.698828 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:26:50.698828 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:26:50.698828 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:26:50.698828 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:26:50.698828 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:26:50.698828 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:26:50.698828 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:26:50.698828 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:26:50.698828 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:26:50.698828 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 could not be found. May 17 17:26:50.698828 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:26:50.698828 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:26:50.698828 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:26:50.698828 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:26:50.698828 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:26:50.698828 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:26:50.698828 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:26:50.698828 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:26:50.698828 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:26:50.700388 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:26:50.700388 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:26:50.700388 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:26:50.700388 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:26:50.700388 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:26:50.700388 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:26:50.700388 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:26:50.700388 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 could not be found. May 17 17:26:50.700388 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:26:50.700388 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:26:50.700388 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:26:50.700388 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:26:50.700388 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:26:50.700388 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:26:50.700388 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:26:50.700388 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:26:50.700388 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 could not be found. May 17 17:26:50.700388 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:26:50.701709 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8aad1d98-c9f4-4136-8898-3fe9881f70bb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Returning 404 to user: Instance bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:26:50.701709 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8aad1d98-c9f4-4136-8898-3fe9881f70bb tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 404 len: 111 microversion: 2.20 time: 0.031439 May 17 17:26:50.701709 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 273/604] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:26:50 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 17:26:50.707796 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b46545d2-6f41-488a-9068-7cdb6d7c1d36 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '.version_select at 0x7f73d01878b0>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:50.796624 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b46545d2-6f41-488a-9068-7cdb6d7c1d36 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417574624" status: 204 len: 0 microversion: 2.20 time: 0.093418 May 17 17:26:50.797255 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 332/605] 10.222.0.88 () {60 vars in 1261 bytes} [Tue May 17 17:26:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417574624 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 17 17:26:51.546112 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b2b3f050-7b1c-46a8-a95d-6d0c5a61622c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Action: 'create', calling method: .version_select at 0x7f73d0091310>, body: {"keypair": {"name": "tempest-keypair-367532853", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEq8BgzF1OR6G8Gwix/f8eGtlaSYiMkkCGfDrXcdqIwEFU+PoNzORK/9zwzdQ5/jWQrMiCw1gmi50N+G64XCWsEkIJPni6gZBS5QyNStbrhoT5571z5nZx96WaFvslwtPQ=="}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:26:51.560230 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-b2b3f050-7b1c-46a8-a95d-6d0c5a61622c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Getting quotas for project 649dd5d80f4142289f94ccd21ab4d68f. Resources: {'key_pairs'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:26:51.563960 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-b2b3f050-7b1c-46a8-a95d-6d0c5a61622c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Getting quotas for user 49df2bc670324cd088691b8d20fcedab and project 649dd5d80f4142289f94ccd21ab4d68f. Resources: {'key_pairs'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:26:51.636498 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b2b3f050-7b1c-46a8-a95d-6d0c5a61622c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.094414 May 17 17:26:51.637085 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 274/606] 10.222.0.88 () {62 vars in 1199 bytes} [Tue May 17 17:26:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 96 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 17 17:26:53.689009 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8882b550-9b4c-48fa-9435-dd5f1725abb9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-596785028", "imageRef": "800c492c-ff69-4735-b2c9-a2dcaa20aa8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a6597032-505a-40f2-9431-0cbb683c79c9"}], "security_groups": [{"name": "tempest-securitygroup--339263174"}], "key_name": "tempest-keypair-367532853", "user_data": "}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:26:53.787317 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.network.neutron [None req-8882b550-9b4c-48fa-9435-dd5f1725abb9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] validate_networks() for [('a6597032-505a-40f2-9431-0cbb683c79c9', None, None, None, None, None)] {{(pid=117612) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:26:54.155122 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-8882b550-9b4c-48fa-9435-dd5f1725abb9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Flavor limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:26:54.155122 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-8882b550-9b4c-48fa-9435-dd5f1725abb9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Image limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:26:54.155122 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-8882b550-9b4c-48fa-9435-dd5f1725abb9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Flavor pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:26:54.155122 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-8882b550-9b4c-48fa-9435-dd5f1725abb9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Image pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:26:54.155122 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-8882b550-9b4c-48fa-9435-dd5f1725abb9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:26:54.155717 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8882b550-9b4c-48fa-9435-dd5f1725abb9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:54.155811 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8882b550-9b4c-48fa-9435-dd5f1725abb9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:54.156538 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8882b550-9b4c-48fa-9435-dd5f1725abb9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:54.156979 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8882b550-9b4c-48fa-9435-dd5f1725abb9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:54.174633 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-8882b550-9b4c-48fa-9435-dd5f1725abb9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Getting quotas for project 649dd5d80f4142289f94ccd21ab4d68f. Resources: {'cores', 'ram', 'instances'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:26:54.178660 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-8882b550-9b4c-48fa-9435-dd5f1725abb9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Getting quotas for user 49df2bc670324cd088691b8d20fcedab and project 649dd5d80f4142289f94ccd21ab4d68f. Resources: {'cores', 'ram', 'instances'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:26:54.190870 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8882b550-9b4c-48fa-9435-dd5f1725abb9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Going to run 1 instances... {{(pid=117612) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:26:54.193275 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8882b550-9b4c-48fa-9435-dd5f1725abb9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='800c492c-ff69-4735-b2c9-a2dcaa20aa8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:26:54.316425 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8882b550-9b4c-48fa-9435-dd5f1725abb9 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.631510 May 17 17:26:54.317002 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 333/607] 10.222.0.88 () {62 vars in 1187 bytes} [Tue May 17 17:26:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 17 17:26:54.327696 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-dbefbcd3-90e4-46c0-8ba0-6e78891d3e66 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:54.328306 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-dbefbcd3-90e4-46c0-8ba0-6e78891d3e66 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:54.384026 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-dbefbcd3-90e4-46c0-8ba0-6e78891d3e66 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:54.392054 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-dbefbcd3-90e4-46c0-8ba0-6e78891d3e66 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:54.393567 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-dbefbcd3-90e4-46c0-8ba0-6e78891d3e66 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:54.395168 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-dbefbcd3-90e4-46c0-8ba0-6e78891d3e66 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1280 microversion: 2.20 time: 0.071981 May 17 17:26:54.395715 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 275/608] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:26:54 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:26:55.413987 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-60505cd5-1011-4b75-aeb5-e86f6d39f305 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:55.414613 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-60505cd5-1011-4b75-aeb5-e86f6d39f305 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:55.421401 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-60505cd5-1011-4b75-aeb5-e86f6d39f305 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:55.421842 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-60505cd5-1011-4b75-aeb5-e86f6d39f305 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:55.422598 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-60505cd5-1011-4b75-aeb5-e86f6d39f305 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:55.423028 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-60505cd5-1011-4b75-aeb5-e86f6d39f305 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:55.488679 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-60505cd5-1011-4b75-aeb5-e86f6d39f305 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:55.497468 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-60505cd5-1011-4b75-aeb5-e86f6d39f305 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:55.498947 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-60505cd5-1011-4b75-aeb5-e86f6d39f305 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:55.500102 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-60505cd5-1011-4b75-aeb5-e86f6d39f305 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1284 microversion: 2.20 time: 0.090922 May 17 17:26:55.500644 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 334/609] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:26:55 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:26:56.517220 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-63fac6aa-3d06-4544-a734-c91bf90ee44b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:56.518696 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-63fac6aa-3d06-4544-a734-c91bf90ee44b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:56.526564 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-63fac6aa-3d06-4544-a734-c91bf90ee44b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:56.527328 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-63fac6aa-3d06-4544-a734-c91bf90ee44b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:56.528384 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-63fac6aa-3d06-4544-a734-c91bf90ee44b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:56.529042 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-63fac6aa-3d06-4544-a734-c91bf90ee44b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:56.616918 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-63fac6aa-3d06-4544-a734-c91bf90ee44b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:56.627385 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-63fac6aa-3d06-4544-a734-c91bf90ee44b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:56.629455 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-63fac6aa-3d06-4544-a734-c91bf90ee44b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:56.630590 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-63fac6aa-3d06-4544-a734-c91bf90ee44b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1350 microversion: 2.20 time: 0.117267 May 17 17:26:56.631274 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 276/610] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:26:56 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1350 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:26:57.650141 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e0ef80d1-316f-4af6-b27c-336f2b92f506 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:57.650729 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e0ef80d1-316f-4af6-b27c-336f2b92f506 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:57.656833 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e0ef80d1-316f-4af6-b27c-336f2b92f506 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:57.657282 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e0ef80d1-316f-4af6-b27c-336f2b92f506 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:57.658044 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e0ef80d1-316f-4af6-b27c-336f2b92f506 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:57.658477 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e0ef80d1-316f-4af6-b27c-336f2b92f506 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:57.889567 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-21108f3c-d89c-48d4-9bc1-fd3b80f95602 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:57.890787 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-21108f3c-d89c-48d4-9bc1-fd3b80f95602 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:57.899637 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-21108f3c-d89c-48d4-9bc1-fd3b80f95602 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:57.900298 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-21108f3c-d89c-48d4-9bc1-fd3b80f95602 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:57.901435 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-21108f3c-d89c-48d4-9bc1-fd3b80f95602 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:57.902036 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-21108f3c-d89c-48d4-9bc1-fd3b80f95602 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:57.930166 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e0ef80d1-316f-4af6-b27c-336f2b92f506 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:57.942139 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-21108f3c-d89c-48d4-9bc1-fd3b80f95602 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056061 May 17 17:26:57.943092 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 277/611] 10.222.0.88 () {58 vars in 1301 bytes} [Tue May 17 17:26:57 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 17 17:26:57.948152 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e0ef80d1-316f-4af6-b27c-336f2b92f506 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:57.950144 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e0ef80d1-316f-4af6-b27c-336f2b92f506 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:57.951290 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e0ef80d1-316f-4af6-b27c-336f2b92f506 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1405 microversion: 2.20 time: 0.304978 May 17 17:26:57.958503 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 335/612] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:26:57 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1405 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:26:58.001560 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-395bdf84-2c60-42ec-bcb9-a99a2693d484 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:58.002062 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-395bdf84-2c60-42ec-bcb9-a99a2693d484 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:58.008022 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-395bdf84-2c60-42ec-bcb9-a99a2693d484 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:58.008477 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-395bdf84-2c60-42ec-bcb9-a99a2693d484 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:58.009244 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-395bdf84-2c60-42ec-bcb9-a99a2693d484 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:58.009686 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-395bdf84-2c60-42ec-bcb9-a99a2693d484 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:58.033920 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-395bdf84-2c60-42ec-bcb9-a99a2693d484 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Going to try to terminate instance {{(pid=117611) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:26:58.085698 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-12f70b48-84ab-4f99-96a0-66a19e00f11e req-b1672598-31b3-4b80-b6e3-0f0254493b76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c833b0fb-2150-403e-a166-d5b80f2025f7", "tag": "ecb996fe-261e-4301-b89c-b7a116cf273b"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:26:58.094289 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-12f70b48-84ab-4f99-96a0-66a19e00f11e req-b1672598-31b3-4b80-b6e3-0f0254493b76 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:58.095076 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-12f70b48-84ab-4f99-96a0-66a19e00f11e req-b1672598-31b3-4b80-b6e3-0f0254493b76 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:58.108617 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-12f70b48-84ab-4f99-96a0-66a19e00f11e req-b1672598-31b3-4b80-b6e3-0f0254493b76 service nova] Creating event network-changed:ecb996fe-261e-4301-b89c-b7a116cf273b for instance c833b0fb-2150-403e-a166-d5b80f2025f7 on hv-cinder-84214 May 17 17:26:58.114532 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-12f70b48-84ab-4f99-96a0-66a19e00f11e req-b1672598-31b3-4b80-b6e3-0f0254493b76 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032991 May 17 17:26:58.115464 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 336/613] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:26:58.332592 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-395bdf84-2c60-42ec-bcb9-a99a2693d484 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 204 len: 0 microversion: 2.1 time: 0.334363 May 17 17:26:58.333110 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 278/614] 10.222.0.88 () {58 vars in 1238 bytes} [Tue May 17 17:26:57 2022] DELETE /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:26:58.341630 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ecfd0c54-1a6c-464c-9d96-ea04643dcbf8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:58.342331 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ecfd0c54-1a6c-464c-9d96-ea04643dcbf8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:58.348918 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ecfd0c54-1a6c-464c-9d96-ea04643dcbf8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:58.349370 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ecfd0c54-1a6c-464c-9d96-ea04643dcbf8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:58.350136 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ecfd0c54-1a6c-464c-9d96-ea04643dcbf8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:58.350568 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ecfd0c54-1a6c-464c-9d96-ea04643dcbf8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:58.478818 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ecfd0c54-1a6c-464c-9d96-ea04643dcbf8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:58.486068 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ecfd0c54-1a6c-464c-9d96-ea04643dcbf8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1672 microversion: 2.1 time: 0.148542 May 17 17:26:58.486686 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 337/615] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:58 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:26:58.969980 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-284c47d1-0b34-4eba-9ea3-b2eab0bd231c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:58.970685 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-284c47d1-0b34-4eba-9ea3-b2eab0bd231c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:58.977668 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-284c47d1-0b34-4eba-9ea3-b2eab0bd231c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:58.978120 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-284c47d1-0b34-4eba-9ea3-b2eab0bd231c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:58.978883 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-284c47d1-0b34-4eba-9ea3-b2eab0bd231c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:58.979317 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-284c47d1-0b34-4eba-9ea3-b2eab0bd231c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:59.151309 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-284c47d1-0b34-4eba-9ea3-b2eab0bd231c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:59.158964 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-284c47d1-0b34-4eba-9ea3-b2eab0bd231c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:59.160776 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-284c47d1-0b34-4eba-9ea3-b2eab0bd231c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:59.161901 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-284c47d1-0b34-4eba-9ea3-b2eab0bd231c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1405 microversion: 2.20 time: 0.196193 May 17 17:26:59.162457 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 279/616] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:26:58 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1405 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:26:59.503793 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-79c7a27f-c695-439f-afc2-c95318a8a036 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:26:59.504427 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-79c7a27f-c695-439f-afc2-c95318a8a036 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:26:59.510303 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-79c7a27f-c695-439f-afc2-c95318a8a036 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:59.510749 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-79c7a27f-c695-439f-afc2-c95318a8a036 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:59.511500 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-79c7a27f-c695-439f-afc2-c95318a8a036 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:26:59.511954 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-79c7a27f-c695-439f-afc2-c95318a8a036 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:26:59.637392 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-79c7a27f-c695-439f-afc2-c95318a8a036 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:26:59.645343 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-79c7a27f-c695-439f-afc2-c95318a8a036 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1672 microversion: 2.1 time: 0.145483 May 17 17:26:59.645893 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 338/617] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:26:59 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1672 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:27:00.179345 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4a13db8a-4247-4af5-8152-89028f99971c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:00.179987 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4a13db8a-4247-4af5-8152-89028f99971c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:00.186317 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4a13db8a-4247-4af5-8152-89028f99971c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:00.186777 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4a13db8a-4247-4af5-8152-89028f99971c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:00.187558 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4a13db8a-4247-4af5-8152-89028f99971c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:00.188006 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4a13db8a-4247-4af5-8152-89028f99971c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:00.555856 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4a13db8a-4247-4af5-8152-89028f99971c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:00.563501 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4a13db8a-4247-4af5-8152-89028f99971c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:00.565094 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4a13db8a-4247-4af5-8152-89028f99971c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:00.566696 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4a13db8a-4247-4af5-8152-89028f99971c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1405 microversion: 2.20 time: 0.391230 May 17 17:27:00.567260 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 280/618] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:27:00 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1405 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:27:00.662384 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d1a394be-b410-4e36-bc1f-751ebfecff3b tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:00.663002 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d1a394be-b410-4e36-bc1f-751ebfecff3b tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:00.668930 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d1a394be-b410-4e36-bc1f-751ebfecff3b tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:00.669385 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d1a394be-b410-4e36-bc1f-751ebfecff3b tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:00.670175 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d1a394be-b410-4e36-bc1f-751ebfecff3b tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:00.670619 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d1a394be-b410-4e36-bc1f-751ebfecff3b tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:00.862752 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d1a394be-b410-4e36-bc1f-751ebfecff3b tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:00.870705 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d1a394be-b410-4e36-bc1f-751ebfecff3b tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1672 microversion: 2.1 time: 0.212357 May 17 17:27:00.871264 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 339/619] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:00 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1672 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:27:01.584728 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e2c26096-58a3-4276-b24f-b60f41b79336 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:01.585339 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e2c26096-58a3-4276-b24f-b60f41b79336 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:01.591724 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e2c26096-58a3-4276-b24f-b60f41b79336 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:01.592179 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e2c26096-58a3-4276-b24f-b60f41b79336 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:01.592977 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e2c26096-58a3-4276-b24f-b60f41b79336 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:01.593414 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e2c26096-58a3-4276-b24f-b60f41b79336 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:01.702246 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-ac819099-8177-4506-8497-27e8e71fe08c req-d07a5809-ea15-4d38-bc87-b6f61e3569d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a87018c-9e2f-4322-8472-dbe43085332f", "name": "network-vif-deleted", "tag": "724c5ba3-c6a4-4624-8067-3660e3e44690"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:27:01.710587 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-ac819099-8177-4506-8497-27e8e71fe08c req-d07a5809-ea15-4d38-bc87-b6f61e3569d8 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:01.711028 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-ac819099-8177-4506-8497-27e8e71fe08c req-d07a5809-ea15-4d38-bc87-b6f61e3569d8 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:01.723013 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-ac819099-8177-4506-8497-27e8e71fe08c req-d07a5809-ea15-4d38-bc87-b6f61e3569d8 service nova] Creating event network-vif-deleted:724c5ba3-c6a4-4624-8067-3660e3e44690 for instance 3a87018c-9e2f-4322-8472-dbe43085332f on hv-cinder-84214 May 17 17:27:01.728045 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-ac819099-8177-4506-8497-27e8e71fe08c req-d07a5809-ea15-4d38-bc87-b6f61e3569d8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029417 May 17 17:27:01.728985 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 340/620] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:27:01.779270 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e2c26096-58a3-4276-b24f-b60f41b79336 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:01.788175 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e2c26096-58a3-4276-b24f-b60f41b79336 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:01.789610 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e2c26096-58a3-4276-b24f-b60f41b79336 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:01.790925 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e2c26096-58a3-4276-b24f-b60f41b79336 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1405 microversion: 2.20 time: 0.210254 May 17 17:27:01.792000 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 281/621] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:27:01 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1405 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:27:01.889917 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8c690618-7adc-44d7-ad8a-682f533e45b9 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:01.891164 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8c690618-7adc-44d7-ad8a-682f533e45b9 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:01.897966 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8c690618-7adc-44d7-ad8a-682f533e45b9 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:01.898410 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8c690618-7adc-44d7-ad8a-682f533e45b9 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:01.899168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8c690618-7adc-44d7-ad8a-682f533e45b9 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:01.899629 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8c690618-7adc-44d7-ad8a-682f533e45b9 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:01.960335 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8c690618-7adc-44d7-ad8a-682f533e45b9 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:01.967880 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8c690618-7adc-44d7-ad8a-682f533e45b9 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1604 microversion: 2.1 time: 0.081942 May 17 17:27:01.968451 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 341/622] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:01 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1604 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:27:02.809708 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-9cbe542a-d345-4ec7-852b-07652fa9a460 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:02.810093 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-9cbe542a-d345-4ec7-852b-07652fa9a460 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:02.817926 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9cbe542a-d345-4ec7-852b-07652fa9a460 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:02.818384 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9cbe542a-d345-4ec7-852b-07652fa9a460 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:02.819158 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9cbe542a-d345-4ec7-852b-07652fa9a460 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:02.819624 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9cbe542a-d345-4ec7-852b-07652fa9a460 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:02.952825 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-9cbe542a-d345-4ec7-852b-07652fa9a460 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:02.960727 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-9cbe542a-d345-4ec7-852b-07652fa9a460 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:02.962209 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-9cbe542a-d345-4ec7-852b-07652fa9a460 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:02.963300 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-9cbe542a-d345-4ec7-852b-07652fa9a460 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1405 microversion: 2.20 time: 0.158228 May 17 17:27:02.963889 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 282/623] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:27:02 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:27:02.985398 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ea26ec83-726c-4d1b-96a8-efd9be5f8975 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:02.986001 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ea26ec83-726c-4d1b-96a8-efd9be5f8975 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:02.992675 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ea26ec83-726c-4d1b-96a8-efd9be5f8975 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:02.993120 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ea26ec83-726c-4d1b-96a8-efd9be5f8975 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:02.993881 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ea26ec83-726c-4d1b-96a8-efd9be5f8975 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:02.994315 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ea26ec83-726c-4d1b-96a8-efd9be5f8975 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:03.023822 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ea26ec83-726c-4d1b-96a8-efd9be5f8975 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:03.024263 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ea26ec83-726c-4d1b-96a8-efd9be5f8975 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:03.024709 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-ea26ec83-726c-4d1b-96a8-efd9be5f8975 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lazy-loading 'fault' on Instance uuid 3a87018c-9e2f-4322-8472-dbe43085332f {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:27:03.065545 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ea26ec83-726c-4d1b-96a8-efd9be5f8975 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:03.073397 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ea26ec83-726c-4d1b-96a8-efd9be5f8975 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 200 len: 1327 microversion: 2.1 time: 0.091740 May 17 17:27:03.073954 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 342/624] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:02 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 1327 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:27:03.981675 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-56008954-b319-4af2-948f-ae40d2ba02ab tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:03.982277 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-56008954-b319-4af2-948f-ae40d2ba02ab tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:03.988570 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-56008954-b319-4af2-948f-ae40d2ba02ab tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:03.989012 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-56008954-b319-4af2-948f-ae40d2ba02ab tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:03.989763 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-56008954-b319-4af2-948f-ae40d2ba02ab tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:03.990193 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-56008954-b319-4af2-948f-ae40d2ba02ab tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:04.090990 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b5496378-cf8e-482a-9078-03fdab5c52c1 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:04.091618 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b5496378-cf8e-482a-9078-03fdab5c52c1 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:04.098045 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b5496378-cf8e-482a-9078-03fdab5c52c1 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:04.098489 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b5496378-cf8e-482a-9078-03fdab5c52c1 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:04.099255 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b5496378-cf8e-482a-9078-03fdab5c52c1 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:04.099722 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b5496378-cf8e-482a-9078-03fdab5c52c1 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:04.113259 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-b5496378-cf8e-482a-9078-03fdab5c52c1 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] HTTP exception thrown: Instance 3a87018c-9e2f-4322-8472-dbe43085332f could not be found. May 17 17:27:04.114167 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-56008954-b319-4af2-948f-ae40d2ba02ab tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:04.115032 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b5496378-cf8e-482a-9078-03fdab5c52c1 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Request method failure captured: May 17 17:27:04.115032 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: request: GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f HTTP/1.1 May 17 17:27:04.115032 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 17 17:27:04.115032 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 17 17:27:04.115032 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Connection: close May 17 17:27:04.115032 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 17 17:27:04.115032 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 17 17:27:04.115032 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.88 May 17 17:27:04.115032 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 17 17:27:04.115032 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 17 17:27:04.115032 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABig9m7397qNk7jDJRlhyJp-yRQaZh-xj7r-i1j24ZkPQC0Mgct3usBafCVshC42M-fjeO9T6yeUpRXsAbzSZ3AzqK8y3nAjGwIayDVJmLaeqRMF0J7eJrSkRR-vUmCKfBYG_3FXZ6veNX1SOcydg0xehS60qk_AFXxHN20w1WQzwIJ2f4 May 17 17:27:04.115032 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 17 17:27:04.115032 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 17 17:27:04.115032 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 17 17:27:04.115032 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 17 17:27:04.115032 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 17 17:27:04.115032 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 17 17:27:04.115032 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Id: f2cc78ca5daa4d7d9df70c24b21bf8cf May 17 17:27:04.115032 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeTestJSON-340644429 May 17 17:27:04.115032 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Role: reader,member May 17 17:27:04.115032 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Roles: reader,member May 17 17:27:04.116633 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f2cc78ca5daa4d7d9df70c24b21bf8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f2cc78ca5daa4d7d9df70c24b21bf8cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f2cc78ca5daa4d7d9df70c24b21bf8cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f2cc78ca5daa4d7d9df70c24b21bf8cf", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:27:04.116633 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeTestJSON-340644429 May 17 17:27:04.116633 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: f2cc78ca5daa4d7d9df70c24b21bf8cf May 17 17:27:04.116633 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeTestJSON-340644429 May 17 17:27:04.116633 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeTestJSON-340644429-project May 17 17:27:04.116633 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 17 17:27:04.116633 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 17 17:27:04.116633 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Id: 19c023452db94dd0a2eea952ae762471 May 17 17:27:04.116633 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeTestJSON-340644429-project May 17 17:27:04.116633 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: method: > May 17 17:27:04.116633 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: exception: Instance 3a87018c-9e2f-4322-8472-dbe43085332f could not be found. May 17 17:27:04.116633 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: action_args: {'id': '3a87018c-9e2f-4322-8472-dbe43085332f'} May 17 17:27:04.117469 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:27:04.117469 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:27:04.117469 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:27:04.117469 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:27:04.117469 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:27:04.117469 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:27:04.117469 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:27:04.117469 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:27:04.117469 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:27:04.117469 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:27:04.117469 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a87018c-9e2f-4322-8472-dbe43085332f could not be found. May 17 17:27:04.117469 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:27:04.117469 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:27:04.117469 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:27:04.117469 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:27:04.117469 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:27:04.117469 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:27:04.117469 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:27:04.117469 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:27:04.117469 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:27:04.118918 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:27:04.118918 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:27:04.118918 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:27:04.118918 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:27:04.118918 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:27:04.118918 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:27:04.118918 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:27:04.118918 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a87018c-9e2f-4322-8472-dbe43085332f could not be found. May 17 17:27:04.118918 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:27:04.118918 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:27:04.118918 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:27:04.118918 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:27:04.118918 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:27:04.118918 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:27:04.118918 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:27:04.118918 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:27:04.118918 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a87018c-9e2f-4322-8472-dbe43085332f could not be found. May 17 17:27:04.118918 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:27:04.120227 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b5496378-cf8e-482a-9078-03fdab5c52c1 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Returning 404 to user: Instance 3a87018c-9e2f-4322-8472-dbe43085332f could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:27:04.120227 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b5496378-cf8e-482a-9078-03fdab5c52c1 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 404 len: 111 microversion: 2.1 time: 0.030399 May 17 17:27:04.120227 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 343/625] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:04 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 17:27:04.122071 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-56008954-b319-4af2-948f-ae40d2ba02ab tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:04.123577 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-56008954-b319-4af2-948f-ae40d2ba02ab tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:04.124729 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-56008954-b319-4af2-948f-ae40d2ba02ab tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1405 microversion: 2.20 time: 0.146883 May 17 17:27:04.125275 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 283/626] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:27:03 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1405 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:27:04.126799 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-fbcdc1d9-5902-46b5-b792-db3e37f20b93 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '.version_select at 0x7f73d00538b0>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:04.207730 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-fbcdc1d9-5902-46b5-b792-db3e37f20b93 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-549233228" status: 202 len: 0 microversion: 2.1 time: 0.084404 May 17 17:27:04.208270 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 344/627] 10.222.0.88 () {58 vars in 1217 bytes} [Tue May 17 17:27:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-549233228 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 17 17:27:04.929180 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-6d019739-ec25-4a7f-a5dd-737158b8ddfb req-548b68b4-2861-4d52-9c2d-47a4e8b6f3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c833b0fb-2150-403e-a166-d5b80f2025f7", "name": "network-vif-plugged", "status": "completed", "tag": "ecb996fe-261e-4301-b89c-b7a116cf273b"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:27:04.937210 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-6d019739-ec25-4a7f-a5dd-737158b8ddfb req-548b68b4-2861-4d52-9c2d-47a4e8b6f3c2 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:04.937652 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-6d019739-ec25-4a7f-a5dd-737158b8ddfb req-548b68b4-2861-4d52-9c2d-47a4e8b6f3c2 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:04.949350 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-6d019739-ec25-4a7f-a5dd-737158b8ddfb req-548b68b4-2861-4d52-9c2d-47a4e8b6f3c2 service nova] Creating event network-vif-plugged:ecb996fe-261e-4301-b89c-b7a116cf273b for instance c833b0fb-2150-403e-a166-d5b80f2025f7 on hv-cinder-84214 May 17 17:27:04.954231 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-6d019739-ec25-4a7f-a5dd-737158b8ddfb req-548b68b4-2861-4d52-9c2d-47a4e8b6f3c2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029451 May 17 17:27:04.954805 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 284/628] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:27:05.142836 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5beea11b-53c3-4001-84c6-5822d3438202 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:05.143543 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5beea11b-53c3-4001-84c6-5822d3438202 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:05.149730 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5beea11b-53c3-4001-84c6-5822d3438202 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:05.150178 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5beea11b-53c3-4001-84c6-5822d3438202 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:05.150954 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5beea11b-53c3-4001-84c6-5822d3438202 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:05.151385 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5beea11b-53c3-4001-84c6-5822d3438202 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:05.153875 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-508291ad-8204-4149-8b6c-64df61bea83a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Action: 'create', calling method: .version_select at 0x7f73d02ecd30>, body: {"keypair": {"name": "tempest-keypair-1764138737", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9sCVf6m+MY11xqtAcVGGOgUY0oLXxGxrlTts9CPdM97HNeqAxooeynpsqaYZH0hVydFTK40rzfYknDbP0CoLBrqBb6Sd6dfKWPPh7r4EyN/33TsCaLFDYE/f4Oy+uGDA=="}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:27:05.169634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-508291ad-8204-4149-8b6c-64df61bea83a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Getting quotas for project f2cc78ca5daa4d7d9df70c24b21bf8cf. Resources: {'key_pairs'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:27:05.173689 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-508291ad-8204-4149-8b6c-64df61bea83a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Getting quotas for user 19c023452db94dd0a2eea952ae762471 and project f2cc78ca5daa4d7d9df70c24b21bf8cf. Resources: {'key_pairs'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:27:05.283877 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5beea11b-53c3-4001-84c6-5822d3438202 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:05.292398 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5beea11b-53c3-4001-84c6-5822d3438202 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:05.293905 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5beea11b-53c3-4001-84c6-5822d3438202 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:05.294992 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5beea11b-53c3-4001-84c6-5822d3438202 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1405 microversion: 2.20 time: 0.156519 May 17 17:27:05.296108 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 345/629] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:27:05 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:27:05.310683 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-508291ad-8204-4149-8b6c-64df61bea83a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.162845 May 17 17:27:05.311275 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 285/630] 10.222.0.88 () {60 vars in 1158 bytes} [Tue May 17 17:27:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:27:06.312762 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7b896143-c579-4a6f-9b79-58e5d6f1b225 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:06.313369 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-7b896143-c579-4a6f-9b79-58e5d6f1b225 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:06.319924 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7b896143-c579-4a6f-9b79-58e5d6f1b225 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:06.320375 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7b896143-c579-4a6f-9b79-58e5d6f1b225 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:06.321138 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7b896143-c579-4a6f-9b79-58e5d6f1b225 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:06.321575 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7b896143-c579-4a6f-9b79-58e5d6f1b225 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:06.465445 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7b896143-c579-4a6f-9b79-58e5d6f1b225 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:06.474825 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7b896143-c579-4a6f-9b79-58e5d6f1b225 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:06.476381 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7b896143-c579-4a6f-9b79-58e5d6f1b225 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:06.477467 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7b896143-c579-4a6f-9b79-58e5d6f1b225 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1405 microversion: 2.20 time: 0.168605 May 17 17:27:06.478168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 346/631] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:27:06 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:27:07.495179 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-bbd14827-8d50-41a8-b466-1952fa0d7830 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:07.495952 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-bbd14827-8d50-41a8-b466-1952fa0d7830 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:07.502543 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bbd14827-8d50-41a8-b466-1952fa0d7830 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:07.502993 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bbd14827-8d50-41a8-b466-1952fa0d7830 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:07.504293 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bbd14827-8d50-41a8-b466-1952fa0d7830 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:07.504730 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bbd14827-8d50-41a8-b466-1952fa0d7830 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:07.615464 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6673c0f3-e872-41f3-8687-0370bdfe6f1a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1883022751", "imageRef": "800c492c-ff69-4735-b2c9-a2dcaa20aa8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ef9b8b57-e7d6-4cd7-847a-e5b40362443c"}], "security_groups": [{"name": "tempest-securitygroup--449209678"}], "key_name": "tempest-keypair-1764138737", "user_data": "}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:27:07.641741 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-bbd14827-8d50-41a8-b466-1952fa0d7830 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:07.650445 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-bbd14827-8d50-41a8-b466-1952fa0d7830 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:07.651964 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-bbd14827-8d50-41a8-b466-1952fa0d7830 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:07.653282 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-bbd14827-8d50-41a8-b466-1952fa0d7830 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1597 microversion: 2.20 time: 0.162565 May 17 17:27:07.654044 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 286/632] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:27:07 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1597 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:27:07.671155 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-efd3102c-ca1d-4da1-9ae1-12898dc96e4a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:07.671680 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-efd3102c-ca1d-4da1-9ae1-12898dc96e4a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:07.677826 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-efd3102c-ca1d-4da1-9ae1-12898dc96e4a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:07.678443 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-efd3102c-ca1d-4da1-9ae1-12898dc96e4a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:07.680764 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-efd3102c-ca1d-4da1-9ae1-12898dc96e4a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:07.681212 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-efd3102c-ca1d-4da1-9ae1-12898dc96e4a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:07.726311 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.network.neutron [None req-6673c0f3-e872-41f3-8687-0370bdfe6f1a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] validate_networks() for [('ef9b8b57-e7d6-4cd7-847a-e5b40362443c', None, None, None, None, None)] {{(pid=117612) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:27:07.787724 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-efd3102c-ca1d-4da1-9ae1-12898dc96e4a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.120075 May 17 17:27:07.789208 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 287/633] 10.222.0.88 () {60 vars in 1315 bytes} [Tue May 17 17:27:07 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 17:27:08.117329 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-6673c0f3-e872-41f3-8687-0370bdfe6f1a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Flavor limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:27:08.117753 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-6673c0f3-e872-41f3-8687-0370bdfe6f1a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Image limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:27:08.118221 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-6673c0f3-e872-41f3-8687-0370bdfe6f1a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Flavor pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:27:08.118626 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-6673c0f3-e872-41f3-8687-0370bdfe6f1a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Image pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:27:08.119034 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-6673c0f3-e872-41f3-8687-0370bdfe6f1a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:27:08.127491 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6673c0f3-e872-41f3-8687-0370bdfe6f1a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:08.129772 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6673c0f3-e872-41f3-8687-0370bdfe6f1a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:08.129772 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6673c0f3-e872-41f3-8687-0370bdfe6f1a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:08.129772 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6673c0f3-e872-41f3-8687-0370bdfe6f1a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:08.145970 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-6673c0f3-e872-41f3-8687-0370bdfe6f1a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Getting quotas for project f2cc78ca5daa4d7d9df70c24b21bf8cf. Resources: {'cores', 'ram', 'instances'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:27:08.149850 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-6673c0f3-e872-41f3-8687-0370bdfe6f1a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Getting quotas for user 19c023452db94dd0a2eea952ae762471 and project f2cc78ca5daa4d7d9df70c24b21bf8cf. Resources: {'cores', 'ram', 'instances'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:27:08.161338 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6673c0f3-e872-41f3-8687-0370bdfe6f1a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Going to run 1 instances... {{(pid=117612) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:27:08.163595 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6673c0f3-e872-41f3-8687-0370bdfe6f1a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='800c492c-ff69-4735-b2c9-a2dcaa20aa8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:27:08.414302 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6673c0f3-e872-41f3-8687-0370bdfe6f1a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.803564 May 17 17:27:08.414920 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 347/634] 10.222.0.88 () {60 vars in 1146 bytes} [Tue May 17 17:27:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 17 17:27:08.424815 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-11bcec1f-610a-44fd-b722-fc0b9c06ff75 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:08.425927 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-11bcec1f-610a-44fd-b722-fc0b9c06ff75 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:08.479652 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-11bcec1f-610a-44fd-b722-fc0b9c06ff75 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:08.485714 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-11bcec1f-610a-44fd-b722-fc0b9c06ff75 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467" status: 200 len: 1238 microversion: 2.1 time: 0.064631 May 17 17:27:08.495376 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 288/635] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:08 2022] GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467 => generated 1238 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:27:09.142982 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-036e9408-6caa-4085-8a00-7d044e6665e5 req-23492bc0-fed4-4e31-a999-37b0163c2da0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c833b0fb-2150-403e-a166-d5b80f2025f7", "tag": "ecb996fe-261e-4301-b89c-b7a116cf273b"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:27:09.151843 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-036e9408-6caa-4085-8a00-7d044e6665e5 req-23492bc0-fed4-4e31-a999-37b0163c2da0 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:09.152357 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-036e9408-6caa-4085-8a00-7d044e6665e5 req-23492bc0-fed4-4e31-a999-37b0163c2da0 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:09.163618 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-036e9408-6caa-4085-8a00-7d044e6665e5 req-23492bc0-fed4-4e31-a999-37b0163c2da0 service nova] Creating event network-changed:ecb996fe-261e-4301-b89c-b7a116cf273b for instance c833b0fb-2150-403e-a166-d5b80f2025f7 on hv-cinder-84214 May 17 17:27:09.168700 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-036e9408-6caa-4085-8a00-7d044e6665e5 req-23492bc0-fed4-4e31-a999-37b0163c2da0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029396 May 17 17:27:09.169358 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 348/636] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:27:09.502633 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-384bdee1-9a21-46e8-8231-14b8d62ae2dd tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:09.503312 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-384bdee1-9a21-46e8-8231-14b8d62ae2dd tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:09.509935 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-384bdee1-9a21-46e8-8231-14b8d62ae2dd tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:09.510684 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-384bdee1-9a21-46e8-8231-14b8d62ae2dd tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:09.512483 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-384bdee1-9a21-46e8-8231-14b8d62ae2dd tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:09.513135 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-384bdee1-9a21-46e8-8231-14b8d62ae2dd tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:09.590407 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-384bdee1-9a21-46e8-8231-14b8d62ae2dd tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:09.598458 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-384bdee1-9a21-46e8-8231-14b8d62ae2dd tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467" status: 200 len: 1242 microversion: 2.1 time: 0.100018 May 17 17:27:09.607686 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 289/637] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:09 2022] GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467 => generated 1242 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:27:10.614820 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-cd204d2a-fabe-4e73-b74f-7ed7042b9306 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:10.615567 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-cd204d2a-fabe-4e73-b74f-7ed7042b9306 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:10.621970 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cd204d2a-fabe-4e73-b74f-7ed7042b9306 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:10.622423 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cd204d2a-fabe-4e73-b74f-7ed7042b9306 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:10.623202 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cd204d2a-fabe-4e73-b74f-7ed7042b9306 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:10.623664 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cd204d2a-fabe-4e73-b74f-7ed7042b9306 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:10.720109 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-cd204d2a-fabe-4e73-b74f-7ed7042b9306 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:10.727476 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-cd204d2a-fabe-4e73-b74f-7ed7042b9306 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467" status: 200 len: 1298 microversion: 2.1 time: 0.116881 May 17 17:27:10.728175 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 349/638] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:10 2022] GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467 => generated 1298 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:27:11.743879 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-616d26a2-f47e-4a68-83b4-2d311b1105eb tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:11.744558 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-616d26a2-f47e-4a68-83b4-2d311b1105eb tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:11.750914 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-616d26a2-f47e-4a68-83b4-2d311b1105eb tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:11.751441 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-616d26a2-f47e-4a68-83b4-2d311b1105eb tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:11.752343 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-616d26a2-f47e-4a68-83b4-2d311b1105eb tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:11.752859 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-616d26a2-f47e-4a68-83b4-2d311b1105eb tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:11.946179 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-616d26a2-f47e-4a68-83b4-2d311b1105eb tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:11.953941 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-616d26a2-f47e-4a68-83b4-2d311b1105eb tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467" status: 200 len: 1363 microversion: 2.1 time: 0.213944 May 17 17:27:11.954713 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 290/639] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:11 2022] GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:27:12.189535 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-7444c387-6c26-42ce-87cc-2ba1525fc0e0 req-9dbd9ffe-03ba-4ccb-9254-2c68fcdb1fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6e24213-8701-4dc9-b4a3-c67d80b14467", "tag": "0605af0a-eefb-479d-a501-b55e67150a94"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:27:12.197961 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-7444c387-6c26-42ce-87cc-2ba1525fc0e0 req-9dbd9ffe-03ba-4ccb-9254-2c68fcdb1fa5 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:12.198399 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-7444c387-6c26-42ce-87cc-2ba1525fc0e0 req-9dbd9ffe-03ba-4ccb-9254-2c68fcdb1fa5 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:12.212176 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-7444c387-6c26-42ce-87cc-2ba1525fc0e0 req-9dbd9ffe-03ba-4ccb-9254-2c68fcdb1fa5 service nova] Creating event network-changed:0605af0a-eefb-479d-a501-b55e67150a94 for instance b6e24213-8701-4dc9-b4a3-c67d80b14467 on hv-cinder-84214 May 17 17:27:12.218148 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-7444c387-6c26-42ce-87cc-2ba1525fc0e0 req-9dbd9ffe-03ba-4ccb-9254-2c68fcdb1fa5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032107 May 17 17:27:12.219030 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 350/640] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:27:12.970905 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-09b4ce42-b32e-4ac8-94df-6c1eb92c8387 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:12.971535 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-09b4ce42-b32e-4ac8-94df-6c1eb92c8387 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:12.978145 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-09b4ce42-b32e-4ac8-94df-6c1eb92c8387 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:12.978594 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-09b4ce42-b32e-4ac8-94df-6c1eb92c8387 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:12.979419 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-09b4ce42-b32e-4ac8-94df-6c1eb92c8387 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:12.979884 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-09b4ce42-b32e-4ac8-94df-6c1eb92c8387 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:13.185135 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-09b4ce42-b32e-4ac8-94df-6c1eb92c8387 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:13.192993 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-09b4ce42-b32e-4ac8-94df-6c1eb92c8387 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467" status: 200 len: 1363 microversion: 2.1 time: 0.225868 May 17 17:27:13.193567 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 291/641] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:12 2022] GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:27:14.210670 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-64ef2a4f-7bb2-4042-95ae-771d9972cf48 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:14.211375 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-64ef2a4f-7bb2-4042-95ae-771d9972cf48 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:14.217466 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-64ef2a4f-7bb2-4042-95ae-771d9972cf48 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:14.233893 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-64ef2a4f-7bb2-4042-95ae-771d9972cf48 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:14.233893 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-64ef2a4f-7bb2-4042-95ae-771d9972cf48 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:14.233893 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-64ef2a4f-7bb2-4042-95ae-771d9972cf48 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:14.344464 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-64ef2a4f-7bb2-4042-95ae-771d9972cf48 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:14.352235 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-64ef2a4f-7bb2-4042-95ae-771d9972cf48 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467" status: 200 len: 1363 microversion: 2.1 time: 0.146225 May 17 17:27:14.352810 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 351/642] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:14 2022] GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:27:15.369898 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-0f724703-08ea-42d2-a20f-0b82cccb6d8e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:15.370939 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-0f724703-08ea-42d2-a20f-0b82cccb6d8e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:15.377254 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0f724703-08ea-42d2-a20f-0b82cccb6d8e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:15.377704 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0f724703-08ea-42d2-a20f-0b82cccb6d8e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:15.379175 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0f724703-08ea-42d2-a20f-0b82cccb6d8e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:15.379628 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0f724703-08ea-42d2-a20f-0b82cccb6d8e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:15.509798 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-0f724703-08ea-42d2-a20f-0b82cccb6d8e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:15.517135 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-0f724703-08ea-42d2-a20f-0b82cccb6d8e tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467" status: 200 len: 1363 microversion: 2.1 time: 0.152116 May 17 17:27:15.517690 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 292/643] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:15 2022] GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:27:16.533697 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-845d1439-ab4f-4448-8d2b-681fd0bdaf36 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:16.534329 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-845d1439-ab4f-4448-8d2b-681fd0bdaf36 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:16.540487 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-845d1439-ab4f-4448-8d2b-681fd0bdaf36 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:16.540931 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-845d1439-ab4f-4448-8d2b-681fd0bdaf36 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:16.541685 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-845d1439-ab4f-4448-8d2b-681fd0bdaf36 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:16.542117 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-845d1439-ab4f-4448-8d2b-681fd0bdaf36 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:16.666928 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-845d1439-ab4f-4448-8d2b-681fd0bdaf36 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:16.674134 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-845d1439-ab4f-4448-8d2b-681fd0bdaf36 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467" status: 200 len: 1363 microversion: 2.1 time: 0.144233 May 17 17:27:16.677128 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 352/644] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:16 2022] GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467 => generated 1363 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:27:16.992793 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-a046d6c8-1319-4cee-9db4-331fdcf4a628 req-60df540d-69d4-4bd1-b739-c3c9f74722f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6e24213-8701-4dc9-b4a3-c67d80b14467", "name": "network-vif-plugged", "status": "completed", "tag": "0605af0a-eefb-479d-a501-b55e67150a94"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:27:17.001155 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-a046d6c8-1319-4cee-9db4-331fdcf4a628 req-60df540d-69d4-4bd1-b739-c3c9f74722f5 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:17.001601 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-a046d6c8-1319-4cee-9db4-331fdcf4a628 req-60df540d-69d4-4bd1-b739-c3c9f74722f5 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:17.012666 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-a046d6c8-1319-4cee-9db4-331fdcf4a628 req-60df540d-69d4-4bd1-b739-c3c9f74722f5 service nova] Creating event network-vif-plugged:0605af0a-eefb-479d-a501-b55e67150a94 for instance b6e24213-8701-4dc9-b4a3-c67d80b14467 on hv-cinder-84214 May 17 17:27:17.017373 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-a046d6c8-1319-4cee-9db4-331fdcf4a628 req-60df540d-69d4-4bd1-b739-c3c9f74722f5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028314 May 17 17:27:17.018017 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 293/645] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:27:17.693547 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-cf8fde6b-ce92-4d06-abbb-13e4c4ce3be3 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:17.694151 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-cf8fde6b-ce92-4d06-abbb-13e4c4ce3be3 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:17.700033 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cf8fde6b-ce92-4d06-abbb-13e4c4ce3be3 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:17.700600 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cf8fde6b-ce92-4d06-abbb-13e4c4ce3be3 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:17.701364 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cf8fde6b-ce92-4d06-abbb-13e4c4ce3be3 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:17.701798 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cf8fde6b-ce92-4d06-abbb-13e4c4ce3be3 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:17.836465 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-cf8fde6b-ce92-4d06-abbb-13e4c4ce3be3 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:17.843640 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-cf8fde6b-ce92-4d06-abbb-13e4c4ce3be3 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467" status: 200 len: 1363 microversion: 2.1 time: 0.154711 May 17 17:27:17.844203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 353/646] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:17 2022] GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:27:18.861844 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e6210c8f-c884-4049-8729-887194a7bfe3 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:18.862606 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e6210c8f-c884-4049-8729-887194a7bfe3 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:18.868792 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e6210c8f-c884-4049-8729-887194a7bfe3 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:18.869238 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e6210c8f-c884-4049-8729-887194a7bfe3 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:18.870004 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e6210c8f-c884-4049-8729-887194a7bfe3 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:18.870441 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e6210c8f-c884-4049-8729-887194a7bfe3 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:18.994349 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e6210c8f-c884-4049-8729-887194a7bfe3 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:19.001832 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e6210c8f-c884-4049-8729-887194a7bfe3 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467" status: 200 len: 1363 microversion: 2.1 time: 0.144661 May 17 17:27:19.002393 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 294/647] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:18 2022] GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467 => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:27:20.018024 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-672f1f96-ea10-462c-bab5-08f4e2803d0f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:20.019220 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-672f1f96-ea10-462c-bab5-08f4e2803d0f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:20.025137 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-672f1f96-ea10-462c-bab5-08f4e2803d0f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:20.025584 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-672f1f96-ea10-462c-bab5-08f4e2803d0f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:20.026340 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-672f1f96-ea10-462c-bab5-08f4e2803d0f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:20.026772 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-672f1f96-ea10-462c-bab5-08f4e2803d0f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:20.152324 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-672f1f96-ea10-462c-bab5-08f4e2803d0f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:20.159370 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-672f1f96-ea10-462c-bab5-08f4e2803d0f tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467" status: 200 len: 1549 microversion: 2.1 time: 0.145162 May 17 17:27:20.160209 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 354/648] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:20 2022] GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467 => generated 1549 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:27:20.175540 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-867fa8d0-fbe1-4f42-b4e9-221ca5002ba5 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:20.176052 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-867fa8d0-fbe1-4f42-b4e9-221ca5002ba5 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:20.182371 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-867fa8d0-fbe1-4f42-b4e9-221ca5002ba5 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:20.182826 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-867fa8d0-fbe1-4f42-b4e9-221ca5002ba5 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:20.183625 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-867fa8d0-fbe1-4f42-b4e9-221ca5002ba5 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:20.184069 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-867fa8d0-fbe1-4f42-b4e9-221ca5002ba5 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:20.258188 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-867fa8d0-fbe1-4f42-b4e9-221ca5002ba5 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.086474 May 17 17:27:20.258786 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 295/649] 10.222.0.88 () {58 vars in 1274 bytes} [Tue May 17 17:27:20 2022] GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:27:21.269567 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-3e6098d3-0bd1-429a-a804-ce8521f5b6f8 req-cdb2f66a-42e6-4a77-84a8-1cd2f09b24ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6e24213-8701-4dc9-b4a3-c67d80b14467", "tag": "0605af0a-eefb-479d-a501-b55e67150a94"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:27:21.277673 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-3e6098d3-0bd1-429a-a804-ce8521f5b6f8 req-cdb2f66a-42e6-4a77-84a8-1cd2f09b24ba service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:21.278116 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-3e6098d3-0bd1-429a-a804-ce8521f5b6f8 req-cdb2f66a-42e6-4a77-84a8-1cd2f09b24ba service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:21.289680 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-3e6098d3-0bd1-429a-a804-ce8521f5b6f8 req-cdb2f66a-42e6-4a77-84a8-1cd2f09b24ba service nova] Creating event network-changed:0605af0a-eefb-479d-a501-b55e67150a94 for instance b6e24213-8701-4dc9-b4a3-c67d80b14467 on hv-cinder-84214 May 17 17:27:21.294735 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-3e6098d3-0bd1-429a-a804-ce8521f5b6f8 req-cdb2f66a-42e6-4a77-84a8-1cd2f09b24ba service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086429 May 17 17:27:21.295319 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 355/650] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:27:26.645796 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-9a822e58-acde-4243-9d6c-6c590268c29d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:26.646275 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-9a822e58-acde-4243-9d6c-6c590268c29d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:26.652372 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9a822e58-acde-4243-9d6c-6c590268c29d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:26.652825 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9a822e58-acde-4243-9d6c-6c590268c29d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:26.653585 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9a822e58-acde-4243-9d6c-6c590268c29d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:26.654018 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9a822e58-acde-4243-9d6c-6c590268c29d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:26.782334 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.objects.instance [None req-9a822e58-acde-4243-9d6c-6c590268c29d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lazy-loading 'services' on Instance uuid de553cb6-1884-4291-a670-74718d9705e0 {{(pid=117611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:27:27.114649 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-9a822e58-acde-4243-9d6c-6c590268c29d tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "DELETE /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0/os-volume_attachments/7ea9b902-e617-4332-92c7-65b139298d6a" status: 202 len: 0 microversion: 2.1 time: 0.473454 May 17 17:27:27.115189 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 296/651] 10.222.0.88 () {58 vars in 1415 bytes} [Tue May 17 17:27:26 2022] DELETE /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0/os-volume_attachments/7ea9b902-e617-4332-92c7-65b139298d6a => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:27:27.124190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-99bc5cae-99eb-4027-8c4c-c3df55e8f8b0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:27.125182 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-99bc5cae-99eb-4027-8c4c-c3df55e8f8b0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:27.131766 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-99bc5cae-99eb-4027-8c4c-c3df55e8f8b0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:27.132218 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-99bc5cae-99eb-4027-8c4c-c3df55e8f8b0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:27.132983 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-99bc5cae-99eb-4027-8c4c-c3df55e8f8b0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:27.133452 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-99bc5cae-99eb-4027-8c4c-c3df55e8f8b0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:27.162280 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-99bc5cae-99eb-4027-8c4c-c3df55e8f8b0 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042389 May 17 17:27:27.162818 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 356/652] 10.222.0.88 () {58 vars in 1301 bytes} [Tue May 17 17:27:27 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:27:28.174447 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a8ec0b0f-f0fe-4dbb-a243-5095cb3afb12 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:28.181540 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a8ec0b0f-f0fe-4dbb-a243-5095cb3afb12 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:28.182601 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a8ec0b0f-f0fe-4dbb-a243-5095cb3afb12 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:28.183052 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a8ec0b0f-f0fe-4dbb-a243-5095cb3afb12 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:28.183842 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a8ec0b0f-f0fe-4dbb-a243-5095cb3afb12 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:28.184282 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a8ec0b0f-f0fe-4dbb-a243-5095cb3afb12 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:28.213886 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a8ec0b0f-f0fe-4dbb-a243-5095cb3afb12 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043674 May 17 17:27:28.214464 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 297/653] 10.222.0.88 () {58 vars in 1301 bytes} [Tue May 17 17:27:28 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:27:29.226791 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f3cd10bb-e195-42ef-ba58-b67dca4dbbac tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:29.227738 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f3cd10bb-e195-42ef-ba58-b67dca4dbbac tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:29.233716 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f3cd10bb-e195-42ef-ba58-b67dca4dbbac tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:29.234845 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f3cd10bb-e195-42ef-ba58-b67dca4dbbac tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:29.234977 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f3cd10bb-e195-42ef-ba58-b67dca4dbbac tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:29.235322 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f3cd10bb-e195-42ef-ba58-b67dca4dbbac tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:29.263667 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f3cd10bb-e195-42ef-ba58-b67dca4dbbac tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040675 May 17 17:27:29.264203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 357/654] 10.222.0.88 () {58 vars in 1301 bytes} [Tue May 17 17:27:29 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 17:27:29.339256 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-9dd0145b-0cbf-4ed5-819f-809b8c389a77 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:29.339787 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-9dd0145b-0cbf-4ed5-819f-809b8c389a77 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:29.346056 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9dd0145b-0cbf-4ed5-819f-809b8c389a77 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:29.347030 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9dd0145b-0cbf-4ed5-819f-809b8c389a77 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:29.347829 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9dd0145b-0cbf-4ed5-819f-809b8c389a77 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:29.348268 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9dd0145b-0cbf-4ed5-819f-809b8c389a77 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:29.373152 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-9dd0145b-0cbf-4ed5-819f-809b8c389a77 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Going to try to terminate instance {{(pid=117611) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:27:29.680918 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-9dd0145b-0cbf-4ed5-819f-809b8c389a77 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "DELETE /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 204 len: 0 microversion: 2.1 time: 0.345104 May 17 17:27:29.681505 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 298/655] 10.222.0.88 () {58 vars in 1238 bytes} [Tue May 17 17:27:29 2022] DELETE /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:27:29.689358 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0244cb99-a50c-4520-91d5-faa6b6251de1 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:29.692185 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0244cb99-a50c-4520-91d5-faa6b6251de1 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:29.695834 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0244cb99-a50c-4520-91d5-faa6b6251de1 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:29.696284 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0244cb99-a50c-4520-91d5-faa6b6251de1 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:29.697048 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0244cb99-a50c-4520-91d5-faa6b6251de1 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:29.697483 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0244cb99-a50c-4520-91d5-faa6b6251de1 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:29.823221 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0244cb99-a50c-4520-91d5-faa6b6251de1 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:29.830442 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0244cb99-a50c-4520-91d5-faa6b6251de1 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1689 microversion: 2.1 time: 0.144875 May 17 17:27:29.831668 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 358/656] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:29 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1689 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:27:30.848711 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8011681f-b1d3-4e01-af8e-d296f7f3aa81 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:30.849397 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8011681f-b1d3-4e01-af8e-d296f7f3aa81 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:30.855653 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8011681f-b1d3-4e01-af8e-d296f7f3aa81 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:30.856095 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8011681f-b1d3-4e01-af8e-d296f7f3aa81 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:30.856845 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8011681f-b1d3-4e01-af8e-d296f7f3aa81 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:30.857273 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8011681f-b1d3-4e01-af8e-d296f7f3aa81 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:30.981971 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8011681f-b1d3-4e01-af8e-d296f7f3aa81 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:30.989221 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8011681f-b1d3-4e01-af8e-d296f7f3aa81 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1689 microversion: 2.1 time: 0.145168 May 17 17:27:30.989791 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 299/657] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:30 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1689 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:27:32.005691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f53d071e-f71f-4ba2-b118-4c3914b5164f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:32.006308 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f53d071e-f71f-4ba2-b118-4c3914b5164f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:32.012080 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f53d071e-f71f-4ba2-b118-4c3914b5164f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:32.012529 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f53d071e-f71f-4ba2-b118-4c3914b5164f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:32.013295 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f53d071e-f71f-4ba2-b118-4c3914b5164f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:32.013728 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f53d071e-f71f-4ba2-b118-4c3914b5164f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:32.141309 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f53d071e-f71f-4ba2-b118-4c3914b5164f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:32.148544 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f53d071e-f71f-4ba2-b118-4c3914b5164f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1689 microversion: 2.1 time: 0.147305 May 17 17:27:32.149112 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 359/658] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:32 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1689 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:27:33.165871 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-fd194f21-a456-4ff2-a3fb-e8cbdd9470b9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:33.166487 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-fd194f21-a456-4ff2-a3fb-e8cbdd9470b9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:33.172968 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fd194f21-a456-4ff2-a3fb-e8cbdd9470b9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:33.173419 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fd194f21-a456-4ff2-a3fb-e8cbdd9470b9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:33.174194 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fd194f21-a456-4ff2-a3fb-e8cbdd9470b9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:33.174640 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fd194f21-a456-4ff2-a3fb-e8cbdd9470b9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:33.301255 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-fd194f21-a456-4ff2-a3fb-e8cbdd9470b9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:33.308667 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-fd194f21-a456-4ff2-a3fb-e8cbdd9470b9 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1689 microversion: 2.1 time: 0.146686 May 17 17:27:33.309233 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 300/659] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:33 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1689 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:27:34.327371 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-773e79ab-96b3-42bc-ae42-ffcf37c8b87a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:34.328729 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-773e79ab-96b3-42bc-ae42-ffcf37c8b87a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:34.335355 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-773e79ab-96b3-42bc-ae42-ffcf37c8b87a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:34.336514 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-773e79ab-96b3-42bc-ae42-ffcf37c8b87a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:34.337509 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-773e79ab-96b3-42bc-ae42-ffcf37c8b87a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:34.338138 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-773e79ab-96b3-42bc-ae42-ffcf37c8b87a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:34.598235 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-773e79ab-96b3-42bc-ae42-ffcf37c8b87a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:34.606377 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-773e79ab-96b3-42bc-ae42-ffcf37c8b87a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1622 microversion: 2.1 time: 0.284402 May 17 17:27:34.608179 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 360/660] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:34 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1622 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:27:34.609911 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-53f22f03-5a63-497d-95e6-73da8813c25b req-dfbca0f4-e215-4460-b7b9-534fbebdd335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de553cb6-1884-4291-a670-74718d9705e0", "name": "network-vif-deleted", "tag": "917f3696-6eaa-402a-9e6a-03c0b7b05692"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:27:34.619774 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-53f22f03-5a63-497d-95e6-73da8813c25b req-dfbca0f4-e215-4460-b7b9-534fbebdd335 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:34.620216 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-53f22f03-5a63-497d-95e6-73da8813c25b req-dfbca0f4-e215-4460-b7b9-534fbebdd335 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:34.633871 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-53f22f03-5a63-497d-95e6-73da8813c25b req-dfbca0f4-e215-4460-b7b9-534fbebdd335 service nova] Creating event network-vif-deleted:917f3696-6eaa-402a-9e6a-03c0b7b05692 for instance de553cb6-1884-4291-a670-74718d9705e0 on hv-cinder-84214 May 17 17:27:34.638815 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-53f22f03-5a63-497d-95e6-73da8813c25b req-dfbca0f4-e215-4460-b7b9-534fbebdd335 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032677 May 17 17:27:34.639411 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 301/661] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:27:35.624134 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-252f521d-b97a-4f7e-a8c8-b90dc061af20 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:35.624750 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-252f521d-b97a-4f7e-a8c8-b90dc061af20 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:35.630685 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-252f521d-b97a-4f7e-a8c8-b90dc061af20 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:35.631162 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-252f521d-b97a-4f7e-a8c8-b90dc061af20 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:35.631960 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-252f521d-b97a-4f7e-a8c8-b90dc061af20 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:35.632405 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-252f521d-b97a-4f7e-a8c8-b90dc061af20 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:35.663973 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-252f521d-b97a-4f7e-a8c8-b90dc061af20 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:35.664421 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-252f521d-b97a-4f7e-a8c8-b90dc061af20 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:35.664898 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-252f521d-b97a-4f7e-a8c8-b90dc061af20 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lazy-loading 'fault' on Instance uuid de553cb6-1884-4291-a670-74718d9705e0 {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:27:35.703966 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-252f521d-b97a-4f7e-a8c8-b90dc061af20 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:35.711808 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-252f521d-b97a-4f7e-a8c8-b90dc061af20 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 200 len: 1335 microversion: 2.1 time: 0.091686 May 17 17:27:35.712376 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 361/662] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:35 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 1335 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:27:36.729272 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a32ee7b6-5e2b-4956-b7e0-f3140314b52e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:36.729960 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a32ee7b6-5e2b-4956-b7e0-f3140314b52e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: de553cb6-1884-4291-a670-74718d9705e0] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:36.736613 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a32ee7b6-5e2b-4956-b7e0-f3140314b52e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:36.737140 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a32ee7b6-5e2b-4956-b7e0-f3140314b52e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:36.737899 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a32ee7b6-5e2b-4956-b7e0-f3140314b52e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:36.738329 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a32ee7b6-5e2b-4956-b7e0-f3140314b52e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:36.751037 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-a32ee7b6-5e2b-4956-b7e0-f3140314b52e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] HTTP exception thrown: Instance de553cb6-1884-4291-a670-74718d9705e0 could not be found. May 17 17:27:36.753152 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a32ee7b6-5e2b-4956-b7e0-f3140314b52e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Request method failure captured: May 17 17:27:36.753152 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 HTTP/1.1 May 17 17:27:36.753152 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:27:36.753152 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:27:36.753152 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:27:36.753152 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:27:36.753152 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:27:36.753152 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:27:36.753152 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:27:36.753152 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:27:36.753152 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9nCRi7Ba9wQiT8Z77JafySk8CdhUt_ec4kFMIRq6DJ0yX_by762ZReR6jSTE7KXCyjCidygrSXAWsVX8isiTVL587-vJGZ3qsfPn7-65abLAEk6QPzTaTbYhBW-eVDouiob09eQRF2fFsF4z6eAkOVL065D-HYqt2yjlfRzYvbvUJA May 17 17:27:36.753152 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:27:36.753152 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:27:36.753152 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:27:36.753152 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:27:36.753152 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:27:36.753152 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:27:36.753152 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: d2b0be03d2fd4baf84d7d0b462392cba May 17 17:27:36.753152 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-82631249 May 17 17:27:36.753152 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:27:36.753152 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:27:36.754780 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d2b0be03d2fd4baf84d7d0b462392cba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/d2b0be03d2fd4baf84d7d0b462392cba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d2b0be03d2fd4baf84d7d0b462392cba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_d2b0be03d2fd4baf84d7d0b462392cba", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:27:36.754780 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-ServerRescueNegativeTestJSON-82631249 May 17 17:27:36.754780 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: d2b0be03d2fd4baf84d7d0b462392cba May 17 17:27:36.754780 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-82631249 May 17 17:27:36.754780 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-ServerRescueNegativeTestJSON-82631249-project May 17 17:27:36.754780 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:27:36.754780 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:27:36.754780 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 8ebdfee8d3d64c2696e9c5695cebdba3 May 17 17:27:36.754780 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-ServerRescueNegativeTestJSON-82631249-project May 17 17:27:36.754780 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:27:36.754780 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Instance de553cb6-1884-4291-a670-74718d9705e0 could not be found. May 17 17:27:36.754780 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': 'de553cb6-1884-4291-a670-74718d9705e0'} May 17 17:27:36.755774 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:27:36.755774 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:27:36.755774 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:27:36.755774 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:27:36.755774 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:27:36.755774 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:27:36.755774 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:27:36.755774 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:27:36.755774 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:27:36.755774 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:27:36.755774 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de553cb6-1884-4291-a670-74718d9705e0 could not be found. May 17 17:27:36.755774 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:27:36.755774 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:27:36.755774 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:27:36.755774 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:27:36.755774 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:27:36.755774 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:27:36.755774 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:27:36.755774 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:27:36.755774 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:27:36.757287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:27:36.757287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:27:36.757287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:27:36.757287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:27:36.757287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:27:36.757287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:27:36.757287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:27:36.757287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de553cb6-1884-4291-a670-74718d9705e0 could not be found. May 17 17:27:36.757287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:27:36.757287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:27:36.757287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:27:36.757287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:27:36.757287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:27:36.757287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:27:36.757287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:27:36.757287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:27:36.757287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de553cb6-1884-4291-a670-74718d9705e0 could not be found. May 17 17:27:36.757287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:27:36.758803 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a32ee7b6-5e2b-4956-b7e0-f3140314b52e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Returning 404 to user: Instance de553cb6-1884-4291-a670-74718d9705e0 could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:27:36.758803 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a32ee7b6-5e2b-4956-b7e0-f3140314b52e tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0" status: 404 len: 111 microversion: 2.1 time: 0.029371 May 17 17:27:36.758803 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 302/663] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:36 2022] GET /compute/v2.1/servers/de553cb6-1884-4291-a670-74718d9705e0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:27:36.762925 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0d7668f3-4da1-48a0-a30a-e61cf43143db tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '.version_select at 0x7f73d00538b0>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:36.841810 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0d7668f3-4da1-48a0-a30a-e61cf43143db tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-591879903" status: 202 len: 0 microversion: 2.1 time: 0.082560 May 17 17:27:36.842358 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 362/664] 10.222.0.88 () {58 vars in 1217 bytes} [Tue May 17 17:27:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-591879903 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 17 17:27:40.057936 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-65a010d7-7429-47bd-b41d-6d9e9c35b8a7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:40.058417 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-65a010d7-7429-47bd-b41d-6d9e9c35b8a7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:40.064773 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65a010d7-7429-47bd-b41d-6d9e9c35b8a7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:40.065216 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65a010d7-7429-47bd-b41d-6d9e9c35b8a7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:40.065974 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65a010d7-7429-47bd-b41d-6d9e9c35b8a7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:40.066408 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65a010d7-7429-47bd-b41d-6d9e9c35b8a7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:40.091168 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-65a010d7-7429-47bd-b41d-6d9e9c35b8a7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Going to try to terminate instance {{(pid=117611) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:27:40.428145 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-65a010d7-7429-47bd-b41d-6d9e9c35b8a7 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 204 len: 0 microversion: 2.1 time: 0.373676 May 17 17:27:40.428728 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 303/665] 10.222.0.88 () {58 vars in 1238 bytes} [Tue May 17 17:27:40 2022] DELETE /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:27:40.436995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-56011b43-92c7-4127-83de-852b07246407 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:40.440468 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-56011b43-92c7-4127-83de-852b07246407 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:40.444227 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-56011b43-92c7-4127-83de-852b07246407 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:40.444680 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-56011b43-92c7-4127-83de-852b07246407 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:40.445453 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-56011b43-92c7-4127-83de-852b07246407 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:40.445893 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-56011b43-92c7-4127-83de-852b07246407 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:40.572338 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-56011b43-92c7-4127-83de-852b07246407 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:40.579497 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-56011b43-92c7-4127-83de-852b07246407 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1508 microversion: 2.1 time: 0.146625 May 17 17:27:40.580082 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 363/666] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:40 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:27:41.597043 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4c231448-e9ef-4d5c-9183-21919d13c0e5 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:41.597769 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4c231448-e9ef-4d5c-9183-21919d13c0e5 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:41.604018 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4c231448-e9ef-4d5c-9183-21919d13c0e5 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:41.604463 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4c231448-e9ef-4d5c-9183-21919d13c0e5 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:41.605229 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4c231448-e9ef-4d5c-9183-21919d13c0e5 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:41.605662 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4c231448-e9ef-4d5c-9183-21919d13c0e5 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:41.731033 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4c231448-e9ef-4d5c-9183-21919d13c0e5 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:41.738814 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4c231448-e9ef-4d5c-9183-21919d13c0e5 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1508 microversion: 2.1 time: 0.146053 May 17 17:27:41.739364 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 304/667] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:41 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1508 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:27:42.756205 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1ea77de3-21e9-4768-aeb6-46a7554d7b06 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:42.756904 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1ea77de3-21e9-4768-aeb6-46a7554d7b06 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:42.762993 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1ea77de3-21e9-4768-aeb6-46a7554d7b06 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:42.763435 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1ea77de3-21e9-4768-aeb6-46a7554d7b06 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:42.764251 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1ea77de3-21e9-4768-aeb6-46a7554d7b06 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:42.764680 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1ea77de3-21e9-4768-aeb6-46a7554d7b06 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:42.917070 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1ea77de3-21e9-4768-aeb6-46a7554d7b06 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:42.924923 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1ea77de3-21e9-4768-aeb6-46a7554d7b06 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1508 microversion: 2.1 time: 0.172700 May 17 17:27:42.926913 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 364/668] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:42 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:27:43.389967 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-c9867469-d59b-4e82-82e4-bbb3987c01d6 req-fc3f713e-d3d1-4150-ba60-f874fa83ff7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6849325b-2caa-4f21-945b-bff1e4f6b564", "name": "network-vif-deleted", "tag": "8994f556-9e5d-412d-b043-6c3d04fc35e4"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:27:43.398790 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-c9867469-d59b-4e82-82e4-bbb3987c01d6 req-fc3f713e-d3d1-4150-ba60-f874fa83ff7c service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:43.399234 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-c9867469-d59b-4e82-82e4-bbb3987c01d6 req-fc3f713e-d3d1-4150-ba60-f874fa83ff7c service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:43.411646 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-c9867469-d59b-4e82-82e4-bbb3987c01d6 req-fc3f713e-d3d1-4150-ba60-f874fa83ff7c service nova] Creating event network-vif-deleted:8994f556-9e5d-412d-b043-6c3d04fc35e4 for instance 6849325b-2caa-4f21-945b-bff1e4f6b564 on hv-cinder-84214 May 17 17:27:43.416506 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-c9867469-d59b-4e82-82e4-bbb3987c01d6 req-fc3f713e-d3d1-4150-ba60-f874fa83ff7c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030325 May 17 17:27:43.417104 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 305/669] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:27:43.941020 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0229725d-ee65-45b5-b48b-05758c05930a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:43.941616 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0229725d-ee65-45b5-b48b-05758c05930a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:43.947626 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0229725d-ee65-45b5-b48b-05758c05930a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:43.948102 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0229725d-ee65-45b5-b48b-05758c05930a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:43.948874 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0229725d-ee65-45b5-b48b-05758c05930a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:43.949312 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0229725d-ee65-45b5-b48b-05758c05930a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:43.979335 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0229725d-ee65-45b5-b48b-05758c05930a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:43.979838 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0229725d-ee65-45b5-b48b-05758c05930a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:43.980286 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-0229725d-ee65-45b5-b48b-05758c05930a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lazy-loading 'fault' on Instance uuid 6849325b-2caa-4f21-945b-bff1e4f6b564 {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:27:44.023550 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0229725d-ee65-45b5-b48b-05758c05930a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:44.030890 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0229725d-ee65-45b5-b48b-05758c05930a tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 200 len: 1312 microversion: 2.1 time: 0.093720 May 17 17:27:44.031456 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 365/670] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:43 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:27:45.048833 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-213cd724-adc5-4782-b940-06cd88cbc286 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:45.050133 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-213cd724-adc5-4782-b940-06cd88cbc286 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 6849325b-2caa-4f21-945b-bff1e4f6b564] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:45.056147 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-213cd724-adc5-4782-b940-06cd88cbc286 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:45.056594 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-213cd724-adc5-4782-b940-06cd88cbc286 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:45.057348 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-213cd724-adc5-4782-b940-06cd88cbc286 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:45.057779 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-213cd724-adc5-4782-b940-06cd88cbc286 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:45.070781 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-213cd724-adc5-4782-b940-06cd88cbc286 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] HTTP exception thrown: Instance 6849325b-2caa-4f21-945b-bff1e4f6b564 could not be found. May 17 17:27:45.072396 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-213cd724-adc5-4782-b940-06cd88cbc286 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Request method failure captured: May 17 17:27:45.072396 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 HTTP/1.1 May 17 17:27:45.072396 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:27:45.072396 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:27:45.072396 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:27:45.072396 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:27:45.072396 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:27:45.072396 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:27:45.072396 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:27:45.072396 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:27:45.072396 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9nCRi7Ba9wQiT8Z77JafySk8CdhUt_ec4kFMIRq6DJ0yX_by762ZReR6jSTE7KXCyjCidygrSXAWsVX8isiTVL587-vJGZ3qsfPn7-65abLAEk6QPzTaTbYhBW-eVDouiob09eQRF2fFsF4z6eAkOVL065D-HYqt2yjlfRzYvbvUJA May 17 17:27:45.072396 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:27:45.072396 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:27:45.072396 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:27:45.072396 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:27:45.072396 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:27:45.072396 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:27:45.072396 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: d2b0be03d2fd4baf84d7d0b462392cba May 17 17:27:45.072396 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-82631249 May 17 17:27:45.072396 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:27:45.072396 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:27:45.073908 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d2b0be03d2fd4baf84d7d0b462392cba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/d2b0be03d2fd4baf84d7d0b462392cba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d2b0be03d2fd4baf84d7d0b462392cba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_d2b0be03d2fd4baf84d7d0b462392cba", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:27:45.073908 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-ServerRescueNegativeTestJSON-82631249 May 17 17:27:45.073908 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: d2b0be03d2fd4baf84d7d0b462392cba May 17 17:27:45.073908 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-82631249 May 17 17:27:45.073908 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-ServerRescueNegativeTestJSON-82631249-project May 17 17:27:45.073908 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:27:45.073908 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:27:45.073908 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 8ebdfee8d3d64c2696e9c5695cebdba3 May 17 17:27:45.073908 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-ServerRescueNegativeTestJSON-82631249-project May 17 17:27:45.073908 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:27:45.073908 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Instance 6849325b-2caa-4f21-945b-bff1e4f6b564 could not be found. May 17 17:27:45.073908 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': '6849325b-2caa-4f21-945b-bff1e4f6b564'} May 17 17:27:45.074670 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:27:45.074670 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:27:45.074670 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:27:45.074670 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:27:45.074670 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:27:45.074670 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:27:45.074670 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:27:45.074670 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:27:45.074670 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:27:45.074670 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:27:45.074670 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6849325b-2caa-4f21-945b-bff1e4f6b564 could not be found. May 17 17:27:45.074670 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:27:45.074670 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:27:45.074670 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:27:45.074670 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:27:45.074670 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:27:45.074670 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:27:45.074670 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:27:45.074670 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:27:45.074670 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:27:45.076203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:27:45.076203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:27:45.076203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:27:45.076203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:27:45.076203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:27:45.076203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:27:45.076203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:27:45.076203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6849325b-2caa-4f21-945b-bff1e4f6b564 could not be found. May 17 17:27:45.076203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:27:45.076203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:27:45.076203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:27:45.076203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:27:45.076203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:27:45.076203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:27:45.076203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:27:45.076203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:27:45.076203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6849325b-2caa-4f21-945b-bff1e4f6b564 could not be found. May 17 17:27:45.076203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:27:45.077508 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-213cd724-adc5-4782-b940-06cd88cbc286 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Returning 404 to user: Instance 6849325b-2caa-4f21-945b-bff1e4f6b564 could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:27:45.077508 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-213cd724-adc5-4782-b940-06cd88cbc286 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564" status: 404 len: 111 microversion: 2.1 time: 0.029565 May 17 17:27:45.077508 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 306/671] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:45 2022] GET /compute/v2.1/servers/6849325b-2caa-4f21-945b-bff1e4f6b564 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 17:27:45.081970 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f70d86fd-f8cb-4c0b-8374-ec0ddb031d73 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:45.082456 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f70d86fd-f8cb-4c0b-8374-ec0ddb031d73 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:45.088218 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f70d86fd-f8cb-4c0b-8374-ec0ddb031d73 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:45.088658 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f70d86fd-f8cb-4c0b-8374-ec0ddb031d73 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:45.089410 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f70d86fd-f8cb-4c0b-8374-ec0ddb031d73 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:45.089839 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f70d86fd-f8cb-4c0b-8374-ec0ddb031d73 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:45.115265 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f70d86fd-f8cb-4c0b-8374-ec0ddb031d73 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Going to try to terminate instance {{(pid=117612) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:27:45.366138 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f70d86fd-f8cb-4c0b-8374-ec0ddb031d73 tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "DELETE /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 204 len: 0 microversion: 2.1 time: 0.287558 May 17 17:27:45.366791 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 366/672] 10.222.0.88 () {58 vars in 1238 bytes} [Tue May 17 17:27:45 2022] DELETE /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 17 17:27:45.374802 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6e9b673f-7bbc-4de0-9135-a4e727044a3f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:45.377526 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6e9b673f-7bbc-4de0-9135-a4e727044a3f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:45.381659 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6e9b673f-7bbc-4de0-9135-a4e727044a3f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:45.382098 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6e9b673f-7bbc-4de0-9135-a4e727044a3f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:45.382863 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6e9b673f-7bbc-4de0-9135-a4e727044a3f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:45.383295 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6e9b673f-7bbc-4de0-9135-a4e727044a3f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:45.512706 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6e9b673f-7bbc-4de0-9135-a4e727044a3f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:45.520640 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6e9b673f-7bbc-4de0-9135-a4e727044a3f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1523 microversion: 2.1 time: 0.149786 May 17 17:27:45.521197 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 307/673] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:45 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:27:46.539257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-39edbbb1-ee3a-439d-8cae-6f20235303ae tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:46.539976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-39edbbb1-ee3a-439d-8cae-6f20235303ae tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:46.546000 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-39edbbb1-ee3a-439d-8cae-6f20235303ae tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:46.546449 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-39edbbb1-ee3a-439d-8cae-6f20235303ae tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:46.547209 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-39edbbb1-ee3a-439d-8cae-6f20235303ae tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:46.547677 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-39edbbb1-ee3a-439d-8cae-6f20235303ae tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:46.675542 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-39edbbb1-ee3a-439d-8cae-6f20235303ae tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:46.682780 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-39edbbb1-ee3a-439d-8cae-6f20235303ae tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1523 microversion: 2.1 time: 0.147986 May 17 17:27:46.683331 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 367/674] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:46 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:27:47.698998 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-11b7163c-e63c-4719-a53b-1895d8db82ef tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:47.699634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-11b7163c-e63c-4719-a53b-1895d8db82ef tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:47.706429 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-11b7163c-e63c-4719-a53b-1895d8db82ef tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:47.706875 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-11b7163c-e63c-4719-a53b-1895d8db82ef tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:47.707676 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-11b7163c-e63c-4719-a53b-1895d8db82ef tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:47.708117 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-11b7163c-e63c-4719-a53b-1895d8db82ef tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:47.839158 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-11b7163c-e63c-4719-a53b-1895d8db82ef tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:47.846367 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-11b7163c-e63c-4719-a53b-1895d8db82ef tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1523 microversion: 2.1 time: 0.151278 May 17 17:27:47.846926 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 308/675] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:47 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:27:48.862597 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c2145815-d7be-4a78-876b-1ad50572a25f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:48.863204 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c2145815-d7be-4a78-876b-1ad50572a25f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:48.869017 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c2145815-d7be-4a78-876b-1ad50572a25f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:48.869465 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c2145815-d7be-4a78-876b-1ad50572a25f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:48.870229 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c2145815-d7be-4a78-876b-1ad50572a25f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:48.870665 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c2145815-d7be-4a78-876b-1ad50572a25f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:49.087430 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c2145815-d7be-4a78-876b-1ad50572a25f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:49.094644 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c2145815-d7be-4a78-876b-1ad50572a25f tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1523 microversion: 2.1 time: 0.236438 May 17 17:27:49.095196 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 368/676] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:48 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1523 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:27:49.364072 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-03bbbfb3-9552-49f5-a1d5-726b1d15ef4e req-a1a4d9d5-276a-4d4c-b9c8-182265aa00fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ea4b9c8-340b-4cd6-abdd-419071fc0b0d", "name": "network-vif-deleted", "tag": "f77db53d-6f2a-4604-ba2c-92c6f8dfd30b"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:27:49.372159 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-03bbbfb3-9552-49f5-a1d5-726b1d15ef4e req-a1a4d9d5-276a-4d4c-b9c8-182265aa00fb service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:49.373122 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-03bbbfb3-9552-49f5-a1d5-726b1d15ef4e req-a1a4d9d5-276a-4d4c-b9c8-182265aa00fb service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:49.383068 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-03bbbfb3-9552-49f5-a1d5-726b1d15ef4e req-a1a4d9d5-276a-4d4c-b9c8-182265aa00fb service nova] Creating event network-vif-deleted:f77db53d-6f2a-4604-ba2c-92c6f8dfd30b for instance 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d on hv-cinder-84214 May 17 17:27:49.387864 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-03bbbfb3-9552-49f5-a1d5-726b1d15ef4e req-a1a4d9d5-276a-4d4c-b9c8-182265aa00fb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028201 May 17 17:27:49.388517 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 309/677] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:27:50.110521 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c6fd3646-e9f1-4b80-933e-53946505ca5c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:50.111127 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c6fd3646-e9f1-4b80-933e-53946505ca5c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:50.117257 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c6fd3646-e9f1-4b80-933e-53946505ca5c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:50.117720 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c6fd3646-e9f1-4b80-933e-53946505ca5c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:50.118476 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c6fd3646-e9f1-4b80-933e-53946505ca5c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:50.118904 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c6fd3646-e9f1-4b80-933e-53946505ca5c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:50.148811 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c6fd3646-e9f1-4b80-933e-53946505ca5c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:50.149250 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c6fd3646-e9f1-4b80-933e-53946505ca5c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:50.149689 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-c6fd3646-e9f1-4b80-933e-53946505ca5c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lazy-loading 'fault' on Instance uuid 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:27:50.190688 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c6fd3646-e9f1-4b80-933e-53946505ca5c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebdfee8d3d64c2696e9c5695cebdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b0be03d2fd4baf84d7d0b462392cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:50.198258 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c6fd3646-e9f1-4b80-933e-53946505ca5c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 200 len: 1312 microversion: 2.1 time: 0.091559 May 17 17:27:50.198812 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 369/678] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:50 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 1312 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:27:51.216625 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d29a6875-1cbf-454b-a104-284aee68763c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:51.217322 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d29a6875-1cbf-454b-a104-284aee68763c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] [instance: 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:51.223461 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d29a6875-1cbf-454b-a104-284aee68763c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:51.223945 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d29a6875-1cbf-454b-a104-284aee68763c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:51.224712 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d29a6875-1cbf-454b-a104-284aee68763c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:51.225151 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d29a6875-1cbf-454b-a104-284aee68763c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:51.238459 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-d29a6875-1cbf-454b-a104-284aee68763c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] HTTP exception thrown: Instance 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d could not be found. May 17 17:27:51.240069 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d29a6875-1cbf-454b-a104-284aee68763c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Request method failure captured: May 17 17:27:51.240069 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d HTTP/1.1 May 17 17:27:51.240069 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:27:51.240069 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:27:51.240069 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:27:51.240069 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:27:51.240069 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:27:51.240069 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:27:51.240069 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:27:51.240069 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:27:51.240069 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9nCRi7Ba9wQiT8Z77JafySk8CdhUt_ec4kFMIRq6DJ0yX_by762ZReR6jSTE7KXCyjCidygrSXAWsVX8isiTVL587-vJGZ3qsfPn7-65abLAEk6QPzTaTbYhBW-eVDouiob09eQRF2fFsF4z6eAkOVL065D-HYqt2yjlfRzYvbvUJA May 17 17:27:51.240069 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:27:51.240069 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:27:51.240069 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:27:51.240069 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:27:51.240069 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:27:51.240069 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:27:51.240069 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: d2b0be03d2fd4baf84d7d0b462392cba May 17 17:27:51.240069 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-82631249 May 17 17:27:51.240069 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:27:51.240069 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:27:51.241633 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d2b0be03d2fd4baf84d7d0b462392cba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/d2b0be03d2fd4baf84d7d0b462392cba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d2b0be03d2fd4baf84d7d0b462392cba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_d2b0be03d2fd4baf84d7d0b462392cba", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:27:51.241633 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-ServerRescueNegativeTestJSON-82631249 May 17 17:27:51.241633 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: d2b0be03d2fd4baf84d7d0b462392cba May 17 17:27:51.241633 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-82631249 May 17 17:27:51.241633 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-ServerRescueNegativeTestJSON-82631249-project May 17 17:27:51.241633 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:27:51.241633 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:27:51.241633 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 8ebdfee8d3d64c2696e9c5695cebdba3 May 17 17:27:51.241633 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-ServerRescueNegativeTestJSON-82631249-project May 17 17:27:51.241633 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:27:51.241633 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Instance 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d could not be found. May 17 17:27:51.241633 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': '2ea4b9c8-340b-4cd6-abdd-419071fc0b0d'} May 17 17:27:51.242602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:27:51.242602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:27:51.242602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:27:51.242602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:27:51.242602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:27:51.242602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:27:51.242602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:27:51.242602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:27:51.242602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:27:51.242602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:27:51.242602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d could not be found. May 17 17:27:51.242602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:27:51.242602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:27:51.242602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:27:51.242602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:27:51.242602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:27:51.242602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:27:51.242602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:27:51.242602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:27:51.242602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:27:51.244111 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:27:51.244111 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:27:51.244111 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:27:51.244111 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:27:51.244111 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:27:51.244111 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:27:51.244111 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:27:51.244111 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d could not be found. May 17 17:27:51.244111 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:27:51.244111 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:27:51.244111 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:27:51.244111 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:27:51.244111 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:27:51.244111 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:27:51.244111 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:27:51.244111 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:27:51.244111 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d could not be found. May 17 17:27:51.244111 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:27:51.245724 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d29a6875-1cbf-454b-a104-284aee68763c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] Returning 404 to user: Instance 2ea4b9c8-340b-4cd6-abdd-419071fc0b0d could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:27:51.245724 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d29a6875-1cbf-454b-a104-284aee68763c tempest-ServerRescueNegativeTestJSON-82631249 tempest-ServerRescueNegativeTestJSON-82631249-project] 10.222.0.88 "GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d" status: 404 len: 111 microversion: 2.1 time: 0.029518 May 17 17:27:51.245724 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 310/679] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:27:51 2022] GET /compute/v2.1/servers/2ea4b9c8-340b-4cd6-abdd-419071fc0b0d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:27:52.797259 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ac150716-ee83-4643-a203-f17bd2889a07 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:52.797760 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ac150716-ee83-4643-a203-f17bd2889a07 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:52.803983 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ac150716-ee83-4643-a203-f17bd2889a07 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:52.804587 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ac150716-ee83-4643-a203-f17bd2889a07 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:52.805368 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ac150716-ee83-4643-a203-f17bd2889a07 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:52.805805 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ac150716-ee83-4643-a203-f17bd2889a07 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:52.828901 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ac150716-ee83-4643-a203-f17bd2889a07 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7/ips" status: 200 len: 152 microversion: 2.20 time: 0.102330 May 17 17:27:52.829646 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 370/680] 10.222.0.88 () {60 vars in 1288 bytes} [Tue May 17 17:27:52 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7/ips => generated 152 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 17:27:55.146938 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-cda11b98-0835-43fc-9ea7-6b3e649c9b0c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:27:55.147498 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-cda11b98-0835-43fc-9ea7-6b3e649c9b0c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:55.153495 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cda11b98-0835-43fc-9ea7-6b3e649c9b0c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:55.153940 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cda11b98-0835-43fc-9ea7-6b3e649c9b0c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:55.154694 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cda11b98-0835-43fc-9ea7-6b3e649c9b0c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:55.155124 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cda11b98-0835-43fc-9ea7-6b3e649c9b0c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:55.177654 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.objects.instance [None req-cda11b98-0835-43fc-9ea7-6b3e649c9b0c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lazy-loading 'flavor' on Instance uuid c833b0fb-2150-403e-a166-d5b80f2025f7 {{(pid=117611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:27:55.775648 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-cda11b98-0835-43fc-9ea7-6b3e649c9b0c tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "POST /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7/action" status: 202 len: 0 microversion: 2.20 time: 0.632849 May 17 17:27:55.776317 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 311/681] 10.222.0.88 () {62 vars in 1318 bytes} [Tue May 17 17:27:55 2022] POST /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7/action => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 17:27:55.784502 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5748b3bd-0274-4283-b0ee-9c623226337e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:55.785538 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5748b3bd-0274-4283-b0ee-9c623226337e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:55.792468 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5748b3bd-0274-4283-b0ee-9c623226337e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:55.792928 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5748b3bd-0274-4283-b0ee-9c623226337e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:55.793703 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5748b3bd-0274-4283-b0ee-9c623226337e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:55.794137 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5748b3bd-0274-4283-b0ee-9c623226337e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:55.939319 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5748b3bd-0274-4283-b0ee-9c623226337e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:55.947851 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5748b3bd-0274-4283-b0ee-9c623226337e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:55.949361 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5748b3bd-0274-4283-b0ee-9c623226337e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:55.950506 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5748b3bd-0274-4283-b0ee-9c623226337e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1722 microversion: 2.20 time: 0.170096 May 17 17:27:55.951066 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 371/682] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:27:55 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:27:56.970001 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d3b60f71-31df-45c7-b7c0-460432fb509f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:56.970688 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d3b60f71-31df-45c7-b7c0-460432fb509f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:56.976844 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d3b60f71-31df-45c7-b7c0-460432fb509f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:56.977292 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d3b60f71-31df-45c7-b7c0-460432fb509f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:56.978048 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d3b60f71-31df-45c7-b7c0-460432fb509f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:56.978480 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d3b60f71-31df-45c7-b7c0-460432fb509f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:57.106549 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d3b60f71-31df-45c7-b7c0-460432fb509f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:57.114550 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d3b60f71-31df-45c7-b7c0-460432fb509f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:57.116028 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d3b60f71-31df-45c7-b7c0-460432fb509f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:57.117202 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d3b60f71-31df-45c7-b7c0-460432fb509f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1722 microversion: 2.20 time: 0.152038 May 17 17:27:57.117799 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 312/683] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:27:56 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:27:58.135610 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8c38d1cd-4c54-42f6-b743-6c87c604a4b2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:58.136220 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8c38d1cd-4c54-42f6-b743-6c87c604a4b2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:58.141987 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8c38d1cd-4c54-42f6-b743-6c87c604a4b2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:58.142923 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8c38d1cd-4c54-42f6-b743-6c87c604a4b2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:58.143711 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8c38d1cd-4c54-42f6-b743-6c87c604a4b2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:58.144148 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8c38d1cd-4c54-42f6-b743-6c87c604a4b2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:58.277913 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8c38d1cd-4c54-42f6-b743-6c87c604a4b2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:58.286054 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8c38d1cd-4c54-42f6-b743-6c87c604a4b2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:58.287551 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8c38d1cd-4c54-42f6-b743-6c87c604a4b2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:58.288770 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8c38d1cd-4c54-42f6-b743-6c87c604a4b2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1722 microversion: 2.20 time: 0.156925 May 17 17:27:58.289318 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 372/684] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:27:58 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:27:59.306249 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-69050ddf-a53c-451b-83f3-93fa7950701a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:27:59.306888 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-69050ddf-a53c-451b-83f3-93fa7950701a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:27:59.313287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-69050ddf-a53c-451b-83f3-93fa7950701a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:59.313729 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-69050ddf-a53c-451b-83f3-93fa7950701a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:59.314483 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-69050ddf-a53c-451b-83f3-93fa7950701a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:27:59.314908 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-69050ddf-a53c-451b-83f3-93fa7950701a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:27:59.442306 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-69050ddf-a53c-451b-83f3-93fa7950701a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:59.450222 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-69050ddf-a53c-451b-83f3-93fa7950701a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:59.451731 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-69050ddf-a53c-451b-83f3-93fa7950701a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:27:59.452875 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-69050ddf-a53c-451b-83f3-93fa7950701a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1722 microversion: 2.20 time: 0.150665 May 17 17:27:59.453622 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 313/685] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:27:59 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:00.471300 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b8e676c5-2ade-4936-a814-ecd1a49a24d8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:00.471847 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b8e676c5-2ade-4936-a814-ecd1a49a24d8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:00.477690 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b8e676c5-2ade-4936-a814-ecd1a49a24d8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:00.483458 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b8e676c5-2ade-4936-a814-ecd1a49a24d8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:00.483458 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b8e676c5-2ade-4936-a814-ecd1a49a24d8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:00.483458 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b8e676c5-2ade-4936-a814-ecd1a49a24d8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:00.607229 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b8e676c5-2ade-4936-a814-ecd1a49a24d8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:00.615640 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b8e676c5-2ade-4936-a814-ecd1a49a24d8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:00.617252 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b8e676c5-2ade-4936-a814-ecd1a49a24d8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:00.624509 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b8e676c5-2ade-4936-a814-ecd1a49a24d8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1722 microversion: 2.20 time: 0.150939 May 17 17:28:00.624509 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 373/686] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:00 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:01.635864 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7c54ede6-9055-4a47-b171-04f03eaab81d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:01.636718 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-7c54ede6-9055-4a47-b171-04f03eaab81d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:01.643983 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7c54ede6-9055-4a47-b171-04f03eaab81d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:01.644507 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7c54ede6-9055-4a47-b171-04f03eaab81d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:01.645272 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7c54ede6-9055-4a47-b171-04f03eaab81d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:01.645732 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7c54ede6-9055-4a47-b171-04f03eaab81d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:01.778166 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7c54ede6-9055-4a47-b171-04f03eaab81d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:01.786502 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7c54ede6-9055-4a47-b171-04f03eaab81d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:01.788023 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7c54ede6-9055-4a47-b171-04f03eaab81d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:01.789179 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-7c54ede6-9055-4a47-b171-04f03eaab81d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1722 microversion: 2.20 time: 0.157452 May 17 17:28:01.789739 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 314/687] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:01 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:02.205968 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5d29b38d-7f69-4aef-aa5e-002a9475ea70 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:02.206462 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5d29b38d-7f69-4aef-aa5e-002a9475ea70 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:02.212116 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5d29b38d-7f69-4aef-aa5e-002a9475ea70 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:02.212565 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5d29b38d-7f69-4aef-aa5e-002a9475ea70 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:02.213336 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5d29b38d-7f69-4aef-aa5e-002a9475ea70 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:02.213771 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5d29b38d-7f69-4aef-aa5e-002a9475ea70 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:02.237051 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5d29b38d-7f69-4aef-aa5e-002a9475ea70 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467/ips" status: 200 len: 146 microversion: 2.1 time: 0.034281 May 17 17:28:02.237623 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 374/688] 10.222.0.88 () {58 vars in 1247 bytes} [Tue May 17 17:28:02 2022] GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467/ips => generated 146 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:28:02.808550 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4f75308c-eccf-4ba7-ad31-daf88c7191b0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:02.809711 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4f75308c-eccf-4ba7-ad31-daf88c7191b0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:02.816020 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4f75308c-eccf-4ba7-ad31-daf88c7191b0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:02.818824 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4f75308c-eccf-4ba7-ad31-daf88c7191b0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:02.818824 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4f75308c-eccf-4ba7-ad31-daf88c7191b0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:02.818824 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4f75308c-eccf-4ba7-ad31-daf88c7191b0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:02.946826 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4f75308c-eccf-4ba7-ad31-daf88c7191b0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:02.954471 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4f75308c-eccf-4ba7-ad31-daf88c7191b0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:02.956649 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4f75308c-eccf-4ba7-ad31-daf88c7191b0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:02.957792 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4f75308c-eccf-4ba7-ad31-daf88c7191b0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1722 microversion: 2.20 time: 0.153292 May 17 17:28:02.958350 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 315/689] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:02 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:03.901374 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1be7ff1a-0f92-41a4-9ead-6481dbca4ffa tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c56a885-c86b-4976-bdbb-5df159a92482"}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:28:03.902503 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1be7ff1a-0f92-41a4-9ead-6481dbca4ffa tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:03.908397 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1be7ff1a-0f92-41a4-9ead-6481dbca4ffa tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:03.908846 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1be7ff1a-0f92-41a4-9ead-6481dbca4ffa tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:03.909618 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1be7ff1a-0f92-41a4-9ead-6481dbca4ffa tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:03.910056 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1be7ff1a-0f92-41a4-9ead-6481dbca4ffa tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:03.974831 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-cbde0a49-592f-4cf6-8df4-49535c95d8d0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:03.975611 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-cbde0a49-592f-4cf6-8df4-49535c95d8d0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:03.988937 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cbde0a49-592f-4cf6-8df4-49535c95d8d0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:03.989394 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cbde0a49-592f-4cf6-8df4-49535c95d8d0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:03.990238 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cbde0a49-592f-4cf6-8df4-49535c95d8d0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:03.990682 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cbde0a49-592f-4cf6-8df4-49535c95d8d0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:04.126155 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-cbde0a49-592f-4cf6-8df4-49535c95d8d0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:04.135148 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-cbde0a49-592f-4cf6-8df4-49535c95d8d0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:04.136839 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-cbde0a49-592f-4cf6-8df4-49535c95d8d0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:04.137998 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-cbde0a49-592f-4cf6-8df4-49535c95d8d0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1722 microversion: 2.20 time: 0.166951 May 17 17:28:04.138578 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 316/690] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:03 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:28:04.672993 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1be7ff1a-0f92-41a4-9ead-6481dbca4ffa tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "POST /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.775412 May 17 17:28:04.673802 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 375/691] 10.222.0.88 () {60 vars in 1322 bytes} [Tue May 17 17:28:03 2022] POST /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467/os-volume_attachments => generated 194 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:28:05.155858 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7a801e89-8210-4a2a-81a9-408f3581fc3d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:05.156407 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-7a801e89-8210-4a2a-81a9-408f3581fc3d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:05.163395 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7a801e89-8210-4a2a-81a9-408f3581fc3d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:05.163874 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7a801e89-8210-4a2a-81a9-408f3581fc3d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:05.164628 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7a801e89-8210-4a2a-81a9-408f3581fc3d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:05.165083 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7a801e89-8210-4a2a-81a9-408f3581fc3d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:05.290716 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7a801e89-8210-4a2a-81a9-408f3581fc3d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:05.298262 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7a801e89-8210-4a2a-81a9-408f3581fc3d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:05.300400 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7a801e89-8210-4a2a-81a9-408f3581fc3d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:05.301542 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-7a801e89-8210-4a2a-81a9-408f3581fc3d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1722 microversion: 2.20 time: 0.149662 May 17 17:28:05.302116 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 317/692] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:05 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:06.321518 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4dbfa953-1480-4677-b724-f141560a1af5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:06.322271 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4dbfa953-1480-4677-b724-f141560a1af5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:06.328269 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4dbfa953-1480-4677-b724-f141560a1af5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:06.328740 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4dbfa953-1480-4677-b724-f141560a1af5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:06.329512 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4dbfa953-1480-4677-b724-f141560a1af5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:06.330457 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4dbfa953-1480-4677-b724-f141560a1af5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:06.459923 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4dbfa953-1480-4677-b724-f141560a1af5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:06.467999 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4dbfa953-1480-4677-b724-f141560a1af5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:06.469622 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4dbfa953-1480-4677-b724-f141560a1af5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:06.471357 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4dbfa953-1480-4677-b724-f141560a1af5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1722 microversion: 2.20 time: 0.154237 May 17 17:28:06.475652 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 376/693] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:06 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:07.489621 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ba05c652-c554-4341-b07c-beda79632d3e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:07.492065 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ba05c652-c554-4341-b07c-beda79632d3e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:07.496511 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ba05c652-c554-4341-b07c-beda79632d3e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:07.496961 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ba05c652-c554-4341-b07c-beda79632d3e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:07.497716 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ba05c652-c554-4341-b07c-beda79632d3e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:07.498146 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ba05c652-c554-4341-b07c-beda79632d3e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:07.633191 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ba05c652-c554-4341-b07c-beda79632d3e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:07.641711 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ba05c652-c554-4341-b07c-beda79632d3e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:07.643864 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ba05c652-c554-4341-b07c-beda79632d3e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:07.645035 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ba05c652-c554-4341-b07c-beda79632d3e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1722 microversion: 2.20 time: 0.159288 May 17 17:28:07.645615 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 318/694] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:07 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:08.663535 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-303a903d-94b9-4530-a201-1279b1b3c2d4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:08.664152 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-303a903d-94b9-4530-a201-1279b1b3c2d4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:08.670470 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-303a903d-94b9-4530-a201-1279b1b3c2d4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:08.670927 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-303a903d-94b9-4530-a201-1279b1b3c2d4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:08.671733 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-303a903d-94b9-4530-a201-1279b1b3c2d4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:08.672261 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-303a903d-94b9-4530-a201-1279b1b3c2d4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:08.799156 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-303a903d-94b9-4530-a201-1279b1b3c2d4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:08.807357 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-303a903d-94b9-4530-a201-1279b1b3c2d4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:08.808935 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-303a903d-94b9-4530-a201-1279b1b3c2d4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:08.810099 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-303a903d-94b9-4530-a201-1279b1b3c2d4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1722 microversion: 2.20 time: 0.150798 May 17 17:28:08.810656 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 377/695] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:08 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:09.828392 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-50f34b27-4d5a-4151-be10-af31caaabc9f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:09.829008 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-50f34b27-4d5a-4151-be10-af31caaabc9f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:09.835363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-50f34b27-4d5a-4151-be10-af31caaabc9f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:09.836426 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-50f34b27-4d5a-4151-be10-af31caaabc9f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:09.837214 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-50f34b27-4d5a-4151-be10-af31caaabc9f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:09.837658 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-50f34b27-4d5a-4151-be10-af31caaabc9f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:09.970276 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-50f34b27-4d5a-4151-be10-af31caaabc9f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:09.979680 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-50f34b27-4d5a-4151-be10-af31caaabc9f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:09.981264 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-50f34b27-4d5a-4151-be10-af31caaabc9f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:09.982430 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-50f34b27-4d5a-4151-be10-af31caaabc9f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1722 microversion: 2.20 time: 0.157863 May 17 17:28:09.982985 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 319/696] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:09 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:11.000479 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0598ff4d-75a0-4de5-ade9-795cddd9e9cc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:11.001151 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0598ff4d-75a0-4de5-ade9-795cddd9e9cc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:11.008318 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0598ff4d-75a0-4de5-ade9-795cddd9e9cc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:11.008993 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0598ff4d-75a0-4de5-ade9-795cddd9e9cc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:11.009985 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0598ff4d-75a0-4de5-ade9-795cddd9e9cc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:11.010580 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0598ff4d-75a0-4de5-ade9-795cddd9e9cc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:11.146909 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0598ff4d-75a0-4de5-ade9-795cddd9e9cc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:11.154713 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0598ff4d-75a0-4de5-ade9-795cddd9e9cc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:11.156231 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0598ff4d-75a0-4de5-ade9-795cddd9e9cc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:11.157379 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0598ff4d-75a0-4de5-ade9-795cddd9e9cc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1722 microversion: 2.20 time: 0.160859 May 17 17:28:11.158472 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 378/697] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:10 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:12.152870 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f3d08b24-4592-4ee3-8418-ad47dc1359da tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:12.153844 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f3d08b24-4592-4ee3-8418-ad47dc1359da tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:12.160119 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f3d08b24-4592-4ee3-8418-ad47dc1359da tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:12.160829 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f3d08b24-4592-4ee3-8418-ad47dc1359da tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:12.161600 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f3d08b24-4592-4ee3-8418-ad47dc1359da tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:12.162120 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f3d08b24-4592-4ee3-8418-ad47dc1359da tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:12.177340 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4e0ff4b7-f436-4ea7-9073-274dc5f205a2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:12.177340 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4e0ff4b7-f436-4ea7-9073-274dc5f205a2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:12.183793 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4e0ff4b7-f436-4ea7-9073-274dc5f205a2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:12.184247 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4e0ff4b7-f436-4ea7-9073-274dc5f205a2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:12.185273 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4e0ff4b7-f436-4ea7-9073-274dc5f205a2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:12.185777 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4e0ff4b7-f436-4ea7-9073-274dc5f205a2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:12.191998 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f3d08b24-4592-4ee3-8418-ad47dc1359da tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042891 May 17 17:28:12.192932 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 320/698] 10.222.0.88 () {58 vars in 1301 bytes} [Tue May 17 17:28:12 2022] GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:28:12.202061 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7ac9fcc6-19a9-4737-a417-34e2f706240c tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:12.202717 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-7ac9fcc6-19a9-4737-a417-34e2f706240c tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:12.208677 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7ac9fcc6-19a9-4737-a417-34e2f706240c tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:12.209125 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7ac9fcc6-19a9-4737-a417-34e2f706240c tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:12.209896 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7ac9fcc6-19a9-4737-a417-34e2f706240c tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:12.210332 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7ac9fcc6-19a9-4737-a417-34e2f706240c tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:12.242068 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-7ac9fcc6-19a9-4737-a417-34e2f706240c tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467/os-volume_attachments/5c56a885-c86b-4976-bdbb-5df159a92482" status: 200 len: 194 microversion: 2.1 time: 0.043578 May 17 17:28:12.242894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 321/699] 10.222.0.88 () {58 vars in 1412 bytes} [Tue May 17 17:28:12 2022] GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467/os-volume_attachments/5c56a885-c86b-4976-bdbb-5df159a92482 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:28:12.329711 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4e0ff4b7-f436-4ea7-9073-274dc5f205a2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:12.338254 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4e0ff4b7-f436-4ea7-9073-274dc5f205a2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:12.339948 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4e0ff4b7-f436-4ea7-9073-274dc5f205a2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:12.341365 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4e0ff4b7-f436-4ea7-9073-274dc5f205a2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1743 microversion: 2.20 time: 0.169063 May 17 17:28:12.344824 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 379/700] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:12 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:28:13.360566 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-405c0909-7eee-49d7-8e8f-86a1214d8c15 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:13.361878 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-405c0909-7eee-49d7-8e8f-86a1214d8c15 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:13.368236 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-405c0909-7eee-49d7-8e8f-86a1214d8c15 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:13.368676 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-405c0909-7eee-49d7-8e8f-86a1214d8c15 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:13.369451 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-405c0909-7eee-49d7-8e8f-86a1214d8c15 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:13.369899 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-405c0909-7eee-49d7-8e8f-86a1214d8c15 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:13.503204 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-405c0909-7eee-49d7-8e8f-86a1214d8c15 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:13.512262 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-405c0909-7eee-49d7-8e8f-86a1214d8c15 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:13.513897 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-405c0909-7eee-49d7-8e8f-86a1214d8c15 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:13.515139 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-405c0909-7eee-49d7-8e8f-86a1214d8c15 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1743 microversion: 2.20 time: 0.158536 May 17 17:28:13.516043 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 322/701] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:13 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:13.915209 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d4bdeff1-2d79-477f-98ba-c4326401ae1a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32951f38-6697-4dca-8411-a93bdc6f5217"}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:28:13.917189 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d4bdeff1-2d79-477f-98ba-c4326401ae1a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:13.923104 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d4bdeff1-2d79-477f-98ba-c4326401ae1a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:13.923602 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d4bdeff1-2d79-477f-98ba-c4326401ae1a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:13.924394 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d4bdeff1-2d79-477f-98ba-c4326401ae1a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:13.924833 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d4bdeff1-2d79-477f-98ba-c4326401ae1a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:14.534112 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d0979f73-fe34-4015-b1b1-9b910b8ff66f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:14.534729 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d0979f73-fe34-4015-b1b1-9b910b8ff66f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:14.541536 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d0979f73-fe34-4015-b1b1-9b910b8ff66f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:14.543403 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d0979f73-fe34-4015-b1b1-9b910b8ff66f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:14.543403 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d0979f73-fe34-4015-b1b1-9b910b8ff66f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:14.543403 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d0979f73-fe34-4015-b1b1-9b910b8ff66f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:14.689569 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d0979f73-fe34-4015-b1b1-9b910b8ff66f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:14.698326 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d0979f73-fe34-4015-b1b1-9b910b8ff66f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:14.699933 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d0979f73-fe34-4015-b1b1-9b910b8ff66f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:14.701308 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d0979f73-fe34-4015-b1b1-9b910b8ff66f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1738 microversion: 2.20 time: 0.171199 May 17 17:28:14.704020 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 323/702] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:14 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:28:14.786510 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d4bdeff1-2d79-477f-98ba-c4326401ae1a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "POST /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.875513 May 17 17:28:14.803219 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 380/703] 10.222.0.88 () {60 vars in 1322 bytes} [Tue May 17 17:28:13 2022] POST /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467/os-volume_attachments => generated 194 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:28:15.499808 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-564bc2c4-2280-40e0-afdc-cf974bebba64 req-4d9ce8b6-3bdb-41d3-baa4-a53a4c47cf0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c833b0fb-2150-403e-a166-d5b80f2025f7", "name": "network-vif-plugged", "status": "completed", "tag": "ecb996fe-261e-4301-b89c-b7a116cf273b"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:28:15.511903 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-564bc2c4-2280-40e0-afdc-cf974bebba64 req-4d9ce8b6-3bdb-41d3-baa4-a53a4c47cf0a service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:15.514108 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-564bc2c4-2280-40e0-afdc-cf974bebba64 req-4d9ce8b6-3bdb-41d3-baa4-a53a4c47cf0a service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:15.529323 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-564bc2c4-2280-40e0-afdc-cf974bebba64 req-4d9ce8b6-3bdb-41d3-baa4-a53a4c47cf0a service nova] Creating event network-vif-plugged:ecb996fe-261e-4301-b89c-b7a116cf273b for instance c833b0fb-2150-403e-a166-d5b80f2025f7 on hv-cinder-84214 May 17 17:28:15.539914 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-564bc2c4-2280-40e0-afdc-cf974bebba64 req-4d9ce8b6-3bdb-41d3-baa4-a53a4c47cf0a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.254454 May 17 17:28:15.542055 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 324/704] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:28:15.723990 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0922615f-417d-4250-b271-42b5369fdf46 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:15.725381 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0922615f-417d-4250-b271-42b5369fdf46 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:15.732474 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0922615f-417d-4250-b271-42b5369fdf46 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:15.733170 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0922615f-417d-4250-b271-42b5369fdf46 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:15.734314 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0922615f-417d-4250-b271-42b5369fdf46 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:15.734753 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0922615f-417d-4250-b271-42b5369fdf46 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:15.919727 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0922615f-417d-4250-b271-42b5369fdf46 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:15.931222 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0922615f-417d-4250-b271-42b5369fdf46 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:15.949006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0922615f-417d-4250-b271-42b5369fdf46 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:15.950613 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0922615f-417d-4250-b271-42b5369fdf46 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1738 microversion: 2.20 time: 0.233604 May 17 17:28:15.951583 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 381/705] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:15 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1738 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:16.969553 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-76f828fb-8ebe-4a98-88e8-673e33e8cfba tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:16.971388 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-76f828fb-8ebe-4a98-88e8-673e33e8cfba tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:16.979387 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-76f828fb-8ebe-4a98-88e8-673e33e8cfba tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:16.980109 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-76f828fb-8ebe-4a98-88e8-673e33e8cfba tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:16.981345 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-76f828fb-8ebe-4a98-88e8-673e33e8cfba tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:16.982004 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-76f828fb-8ebe-4a98-88e8-673e33e8cfba tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:17.140200 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-76f828fb-8ebe-4a98-88e8-673e33e8cfba tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:17.149370 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-76f828fb-8ebe-4a98-88e8-673e33e8cfba tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:17.150875 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-76f828fb-8ebe-4a98-88e8-673e33e8cfba tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:17.152077 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-76f828fb-8ebe-4a98-88e8-673e33e8cfba tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1738 microversion: 2.20 time: 0.187122 May 17 17:28:17.152640 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 325/706] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:16 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:28:18.171453 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c0ae94ea-a89d-4395-949b-efc6e87c084e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:18.172202 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c0ae94ea-a89d-4395-949b-efc6e87c084e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:18.179203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c0ae94ea-a89d-4395-949b-efc6e87c084e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:18.179838 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c0ae94ea-a89d-4395-949b-efc6e87c084e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:18.181509 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c0ae94ea-a89d-4395-949b-efc6e87c084e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:18.182058 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c0ae94ea-a89d-4395-949b-efc6e87c084e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:18.340925 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c0ae94ea-a89d-4395-949b-efc6e87c084e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:18.349950 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c0ae94ea-a89d-4395-949b-efc6e87c084e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:18.351583 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c0ae94ea-a89d-4395-949b-efc6e87c084e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:18.353008 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c0ae94ea-a89d-4395-949b-efc6e87c084e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1738 microversion: 2.20 time: 0.186520 May 17 17:28:18.353643 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 382/707] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:18 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:19.377559 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a3cdfe99-0ad4-465a-9661-77286d43872d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:19.379833 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a3cdfe99-0ad4-465a-9661-77286d43872d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:19.387391 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a3cdfe99-0ad4-465a-9661-77286d43872d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:19.387937 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a3cdfe99-0ad4-465a-9661-77286d43872d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:19.388771 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a3cdfe99-0ad4-465a-9661-77286d43872d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:19.389269 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a3cdfe99-0ad4-465a-9661-77286d43872d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:19.544448 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a3cdfe99-0ad4-465a-9661-77286d43872d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:19.552982 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a3cdfe99-0ad4-465a-9661-77286d43872d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:19.554816 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a3cdfe99-0ad4-465a-9661-77286d43872d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:19.556116 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a3cdfe99-0ad4-465a-9661-77286d43872d tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1738 microversion: 2.20 time: 0.183786 May 17 17:28:19.556776 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 326/708] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:19 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:20.574390 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-493878b3-ac1f-4a80-b1c3-4700aa1573c7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:20.575037 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-493878b3-ac1f-4a80-b1c3-4700aa1573c7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:20.581427 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-493878b3-ac1f-4a80-b1c3-4700aa1573c7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:20.658214 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-493878b3-ac1f-4a80-b1c3-4700aa1573c7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:20.658214 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-493878b3-ac1f-4a80-b1c3-4700aa1573c7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:20.658214 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-493878b3-ac1f-4a80-b1c3-4700aa1573c7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:20.709341 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-493878b3-ac1f-4a80-b1c3-4700aa1573c7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:20.717132 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-493878b3-ac1f-4a80-b1c3-4700aa1573c7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:20.718635 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-493878b3-ac1f-4a80-b1c3-4700aa1573c7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:20.719808 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-493878b3-ac1f-4a80-b1c3-4700aa1573c7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1738 microversion: 2.20 time: 0.149452 May 17 17:28:20.720369 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 383/709] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:20 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:21.743829 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-73b5ae5b-b92d-4da3-9e20-f433f8c1b691 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:21.744343 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-73b5ae5b-b92d-4da3-9e20-f433f8c1b691 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:21.751641 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-73b5ae5b-b92d-4da3-9e20-f433f8c1b691 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:21.752338 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-73b5ae5b-b92d-4da3-9e20-f433f8c1b691 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:21.753402 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-73b5ae5b-b92d-4da3-9e20-f433f8c1b691 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:21.754067 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-73b5ae5b-b92d-4da3-9e20-f433f8c1b691 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:21.910956 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-73b5ae5b-b92d-4da3-9e20-f433f8c1b691 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:21.919798 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-73b5ae5b-b92d-4da3-9e20-f433f8c1b691 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:21.921643 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-73b5ae5b-b92d-4da3-9e20-f433f8c1b691 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:21.923612 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-73b5ae5b-b92d-4da3-9e20-f433f8c1b691 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1738 microversion: 2.20 time: 0.183206 May 17 17:28:21.931988 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 327/710] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:21 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:22.439926 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c2323bd1-e565-4633-9ae5-170dcbb0f8d9 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:22.440856 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c2323bd1-e565-4633-9ae5-170dcbb0f8d9 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:22.449666 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c2323bd1-e565-4633-9ae5-170dcbb0f8d9 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:22.450388 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c2323bd1-e565-4633-9ae5-170dcbb0f8d9 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:22.451347 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c2323bd1-e565-4633-9ae5-170dcbb0f8d9 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:22.451815 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c2323bd1-e565-4633-9ae5-170dcbb0f8d9 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:22.486662 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c2323bd1-e565-4633-9ae5-170dcbb0f8d9 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051143 May 17 17:28:22.487234 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 384/711] 10.222.0.88 () {58 vars in 1301 bytes} [Tue May 17 17:28:22 2022] GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:28:22.642878 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-391efd7a-3283-49a5-ac5d-4ed64e4e54f2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:22.643336 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-391efd7a-3283-49a5-ac5d-4ed64e4e54f2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:22.650205 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-391efd7a-3283-49a5-ac5d-4ed64e4e54f2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:22.650720 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-391efd7a-3283-49a5-ac5d-4ed64e4e54f2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:22.651531 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-391efd7a-3283-49a5-ac5d-4ed64e4e54f2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:22.651975 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-391efd7a-3283-49a5-ac5d-4ed64e4e54f2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:22.682878 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-391efd7a-3283-49a5-ac5d-4ed64e4e54f2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467/os-volume_attachments/5c56a885-c86b-4976-bdbb-5df159a92482" status: 200 len: 194 microversion: 2.1 time: 0.044384 May 17 17:28:22.683667 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 328/712] 10.222.0.88 () {58 vars in 1412 bytes} [Tue May 17 17:28:22 2022] GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467/os-volume_attachments/5c56a885-c86b-4976-bdbb-5df159a92482 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:28:22.702998 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6d4064c3-7e62-4aa4-beaa-0f6f2ec3be43 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:22.702998 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6d4064c3-7e62-4aa4-beaa-0f6f2ec3be43 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:22.710412 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6d4064c3-7e62-4aa4-beaa-0f6f2ec3be43 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:22.711011 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6d4064c3-7e62-4aa4-beaa-0f6f2ec3be43 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:22.712476 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6d4064c3-7e62-4aa4-beaa-0f6f2ec3be43 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:22.712600 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6d4064c3-7e62-4aa4-beaa-0f6f2ec3be43 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:22.821610 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-6d4064c3-7e62-4aa4-beaa-0f6f2ec3be43 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lazy-loading 'services' on Instance uuid b6e24213-8701-4dc9-b4a3-c67d80b14467 {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:28:22.944994 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-2ee694a7-9910-4d7b-a3ae-c00d9942df3f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:22.946279 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-2ee694a7-9910-4d7b-a3ae-c00d9942df3f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:22.954782 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2ee694a7-9910-4d7b-a3ae-c00d9942df3f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:22.955228 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2ee694a7-9910-4d7b-a3ae-c00d9942df3f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:22.956248 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2ee694a7-9910-4d7b-a3ae-c00d9942df3f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:22.956684 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2ee694a7-9910-4d7b-a3ae-c00d9942df3f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:23.036908 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6d4064c3-7e62-4aa4-beaa-0f6f2ec3be43 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467/os-volume_attachments/5c56a885-c86b-4976-bdbb-5df159a92482" status: 202 len: 0 microversion: 2.1 time: 0.346680 May 17 17:28:23.038113 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 385/713] 10.222.0.88 () {58 vars in 1415 bytes} [Tue May 17 17:28:22 2022] DELETE /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467/os-volume_attachments/5c56a885-c86b-4976-bdbb-5df159a92482 => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:28:23.136663 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2ee694a7-9910-4d7b-a3ae-c00d9942df3f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:23.145387 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2ee694a7-9910-4d7b-a3ae-c00d9942df3f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:23.147443 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2ee694a7-9910-4d7b-a3ae-c00d9942df3f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:23.148791 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-2ee694a7-9910-4d7b-a3ae-c00d9942df3f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1738 microversion: 2.20 time: 0.207628 May 17 17:28:23.149282 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 329/714] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:22 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:24.170093 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a43c3149-5624-4119-a3d1-4821d26d140b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:24.176435 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a43c3149-5624-4119-a3d1-4821d26d140b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:24.177385 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a43c3149-5624-4119-a3d1-4821d26d140b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:24.177845 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a43c3149-5624-4119-a3d1-4821d26d140b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:24.178602 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a43c3149-5624-4119-a3d1-4821d26d140b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:24.179038 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a43c3149-5624-4119-a3d1-4821d26d140b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:24.313177 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a43c3149-5624-4119-a3d1-4821d26d140b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:24.322536 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a43c3149-5624-4119-a3d1-4821d26d140b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:24.324724 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a43c3149-5624-4119-a3d1-4821d26d140b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:24.327941 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a43c3149-5624-4119-a3d1-4821d26d140b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1738 microversion: 2.20 time: 0.160498 May 17 17:28:24.327941 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 386/715] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:24 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:25.343780 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-99a339a9-a9c8-4c8f-a038-8323a9c518e1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:25.344325 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-99a339a9-a9c8-4c8f-a038-8323a9c518e1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:25.350418 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-99a339a9-a9c8-4c8f-a038-8323a9c518e1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:25.350860 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-99a339a9-a9c8-4c8f-a038-8323a9c518e1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:25.351649 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-99a339a9-a9c8-4c8f-a038-8323a9c518e1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:25.352105 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-99a339a9-a9c8-4c8f-a038-8323a9c518e1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:25.477302 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-99a339a9-a9c8-4c8f-a038-8323a9c518e1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:25.484968 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-99a339a9-a9c8-4c8f-a038-8323a9c518e1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:25.486445 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-99a339a9-a9c8-4c8f-a038-8323a9c518e1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:25.487618 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-99a339a9-a9c8-4c8f-a038-8323a9c518e1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1738 microversion: 2.20 time: 0.147765 May 17 17:28:25.488233 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 330/716] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:25 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:26.506474 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4dcd8a0f-83a1-45e8-8c4b-1eee8c46822e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:26.507027 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4dcd8a0f-83a1-45e8-8c4b-1eee8c46822e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:26.513330 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4dcd8a0f-83a1-45e8-8c4b-1eee8c46822e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:26.513774 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4dcd8a0f-83a1-45e8-8c4b-1eee8c46822e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:26.514530 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4dcd8a0f-83a1-45e8-8c4b-1eee8c46822e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:26.515028 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4dcd8a0f-83a1-45e8-8c4b-1eee8c46822e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:26.640276 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4dcd8a0f-83a1-45e8-8c4b-1eee8c46822e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:26.648108 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4dcd8a0f-83a1-45e8-8c4b-1eee8c46822e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:26.649597 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4dcd8a0f-83a1-45e8-8c4b-1eee8c46822e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:26.650729 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4dcd8a0f-83a1-45e8-8c4b-1eee8c46822e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1720 microversion: 2.20 time: 0.148857 May 17 17:28:26.651285 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 387/717] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:26 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:27.317833 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8b257de4-bd61-40d7-b0d0-a299cce87828 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:27.318351 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8b257de4-bd61-40d7-b0d0-a299cce87828 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:27.332052 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8b257de4-bd61-40d7-b0d0-a299cce87828 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:27.332052 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8b257de4-bd61-40d7-b0d0-a299cce87828 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:27.332052 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8b257de4-bd61-40d7-b0d0-a299cce87828 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:27.332052 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8b257de4-bd61-40d7-b0d0-a299cce87828 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:27.357266 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8b257de4-bd61-40d7-b0d0-a299cce87828 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467/os-volume_attachments/32951f38-6697-4dca-8411-a93bdc6f5217" status: 200 len: 194 microversion: 2.1 time: 0.043877 May 17 17:28:27.359347 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 331/718] 10.222.0.88 () {58 vars in 1412 bytes} [Tue May 17 17:28:27 2022] GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467/os-volume_attachments/32951f38-6697-4dca-8411-a93bdc6f5217 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:28:27.379045 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-126b190c-aa21-4455-8b0c-721f6f43ef25 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:27.379560 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-126b190c-aa21-4455-8b0c-721f6f43ef25 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:27.385563 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-126b190c-aa21-4455-8b0c-721f6f43ef25 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:27.386016 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-126b190c-aa21-4455-8b0c-721f6f43ef25 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:27.386794 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-126b190c-aa21-4455-8b0c-721f6f43ef25 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:27.387231 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-126b190c-aa21-4455-8b0c-721f6f43ef25 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:27.467175 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-126b190c-aa21-4455-8b0c-721f6f43ef25 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lazy-loading 'services' on Instance uuid b6e24213-8701-4dc9-b4a3-c67d80b14467 {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:28:27.669265 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-fe71f0b6-032f-4107-868a-08adfe6fb46e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:27.669877 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-fe71f0b6-032f-4107-868a-08adfe6fb46e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:27.675698 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fe71f0b6-032f-4107-868a-08adfe6fb46e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:27.676158 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fe71f0b6-032f-4107-868a-08adfe6fb46e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:27.676926 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fe71f0b6-032f-4107-868a-08adfe6fb46e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:27.677365 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fe71f0b6-032f-4107-868a-08adfe6fb46e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:27.683528 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-126b190c-aa21-4455-8b0c-721f6f43ef25 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467/os-volume_attachments/32951f38-6697-4dca-8411-a93bdc6f5217" status: 202 len: 0 microversion: 2.1 time: 0.308242 May 17 17:28:27.684680 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 388/719] 10.222.0.88 () {58 vars in 1415 bytes} [Tue May 17 17:28:27 2022] DELETE /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467/os-volume_attachments/32951f38-6697-4dca-8411-a93bdc6f5217 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:28:27.812771 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-fe71f0b6-032f-4107-868a-08adfe6fb46e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:27.821156 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-fe71f0b6-032f-4107-868a-08adfe6fb46e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:27.822768 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-fe71f0b6-032f-4107-868a-08adfe6fb46e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:27.824973 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-fe71f0b6-032f-4107-868a-08adfe6fb46e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1720 microversion: 2.20 time: 0.158597 May 17 17:28:27.824973 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 332/720] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:27 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:28:28.842828 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4febb2a4-2715-47f8-af65-e89b23f5b1f7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:28.843634 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4febb2a4-2715-47f8-af65-e89b23f5b1f7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:28.850371 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4febb2a4-2715-47f8-af65-e89b23f5b1f7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:28.850888 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4febb2a4-2715-47f8-af65-e89b23f5b1f7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:28.858130 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4febb2a4-2715-47f8-af65-e89b23f5b1f7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:28.858130 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4febb2a4-2715-47f8-af65-e89b23f5b1f7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:28.978441 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4febb2a4-2715-47f8-af65-e89b23f5b1f7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:28.986550 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4febb2a4-2715-47f8-af65-e89b23f5b1f7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:28.988088 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4febb2a4-2715-47f8-af65-e89b23f5b1f7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:28.989231 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4febb2a4-2715-47f8-af65-e89b23f5b1f7 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1720 microversion: 2.20 time: 0.150775 May 17 17:28:28.989789 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 389/721] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:28 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:30.007690 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ca0d92fe-60db-488a-8774-1576253403f0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:30.008266 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ca0d92fe-60db-488a-8774-1576253403f0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:30.014879 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ca0d92fe-60db-488a-8774-1576253403f0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:30.015336 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ca0d92fe-60db-488a-8774-1576253403f0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:30.016141 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ca0d92fe-60db-488a-8774-1576253403f0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:30.017245 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ca0d92fe-60db-488a-8774-1576253403f0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:30.148129 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ca0d92fe-60db-488a-8774-1576253403f0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:30.155830 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ca0d92fe-60db-488a-8774-1576253403f0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:30.158244 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ca0d92fe-60db-488a-8774-1576253403f0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:30.159384 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ca0d92fe-60db-488a-8774-1576253403f0 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1723 microversion: 2.20 time: 0.155915 May 17 17:28:30.159982 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 333/722] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:30 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:30.178993 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-9c5db34b-508f-4672-a364-3dc55ad4ade6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4f88a64-527a-40a9-9efe-004c85dcd2ac"}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:28:30.180696 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-9c5db34b-508f-4672-a364-3dc55ad4ade6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:30.186841 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9c5db34b-508f-4672-a364-3dc55ad4ade6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:30.187350 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9c5db34b-508f-4672-a364-3dc55ad4ade6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:30.188224 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9c5db34b-508f-4672-a364-3dc55ad4ade6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:30.188685 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9c5db34b-508f-4672-a364-3dc55ad4ade6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:30.951990 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-0152fbd5-ffbe-4980-8cdb-4528bd0d68c3 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:30.952916 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-0152fbd5-ffbe-4980-8cdb-4528bd0d68c3 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:30.959127 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0152fbd5-ffbe-4980-8cdb-4528bd0d68c3 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:30.959610 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0152fbd5-ffbe-4980-8cdb-4528bd0d68c3 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:30.960378 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0152fbd5-ffbe-4980-8cdb-4528bd0d68c3 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:30.960815 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0152fbd5-ffbe-4980-8cdb-4528bd0d68c3 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:30.989691 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-0152fbd5-ffbe-4980-8cdb-4528bd0d68c3 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041524 May 17 17:28:30.990246 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 334/723] 10.222.0.88 () {58 vars in 1301 bytes} [Tue May 17 17:28:30 2022] GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 17 17:28:31.092554 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-dbe89b83-a8ff-4628-aeca-6e4db0ba6ba8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:31.095423 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-dbe89b83-a8ff-4628-aeca-6e4db0ba6ba8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:31.100459 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-dbe89b83-a8ff-4628-aeca-6e4db0ba6ba8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:31.100910 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-dbe89b83-a8ff-4628-aeca-6e4db0ba6ba8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:31.101667 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-dbe89b83-a8ff-4628-aeca-6e4db0ba6ba8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:31.102104 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-dbe89b83-a8ff-4628-aeca-6e4db0ba6ba8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:31.129416 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-dbe89b83-a8ff-4628-aeca-6e4db0ba6ba8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040725 May 17 17:28:31.129972 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 335/724] 10.222.0.88 () {58 vars in 1301 bytes} [Tue May 17 17:28:31 2022] GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 17 17:28:31.187467 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1ed41933-834d-4b5c-a8c0-6131e3f878b2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:31.188217 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1ed41933-834d-4b5c-a8c0-6131e3f878b2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:31.194832 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1ed41933-834d-4b5c-a8c0-6131e3f878b2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:31.195488 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1ed41933-834d-4b5c-a8c0-6131e3f878b2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:31.196638 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1ed41933-834d-4b5c-a8c0-6131e3f878b2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:31.197241 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1ed41933-834d-4b5c-a8c0-6131e3f878b2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:31.223943 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-9c5db34b-508f-4672-a364-3dc55ad4ade6 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "POST /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.050657 May 17 17:28:31.226002 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1ed41933-834d-4b5c-a8c0-6131e3f878b2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Going to try to terminate instance {{(pid=117611) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:28:31.229400 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 390/725] 10.222.0.88 () {62 vars in 1363 bytes} [Tue May 17 17:28:30 2022] POST /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7/os-volume_attachments => generated 188 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 17:28:31.299396 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-138fd6f4-1835-4f09-a6c8-e3e4ce514abd req-35018674-25e8-4bdf-8e9f-d877dc3733d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c833b0fb-2150-403e-a166-d5b80f2025f7", "name": "network-vif-unplugged", "status": "completed", "tag": "ecb996fe-261e-4301-b89c-b7a116cf273b"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:28:31.311894 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-138fd6f4-1835-4f09-a6c8-e3e4ce514abd req-35018674-25e8-4bdf-8e9f-d877dc3733d8 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:31.312728 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-138fd6f4-1835-4f09-a6c8-e3e4ce514abd req-35018674-25e8-4bdf-8e9f-d877dc3733d8 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:31.327034 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.compute.server_external_events [req-138fd6f4-1835-4f09-a6c8-e3e4ce514abd req-35018674-25e8-4bdf-8e9f-d877dc3733d8 service nova] Unable to find a host for instance c833b0fb-2150-403e-a166-d5b80f2025f7. Dropping event network-vif-unplugged {{(pid=117612) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 17 17:28:31.328769 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-138fd6f4-1835-4f09-a6c8-e3e4ce514abd req-35018674-25e8-4bdf-8e9f-d877dc3733d8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035709 May 17 17:28:31.330592 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 391/726] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 17 17:28:31.362304 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-90a1de8e-5310-4c2c-b880-5ddff7fa2f4e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:31.362801 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-90a1de8e-5310-4c2c-b880-5ddff7fa2f4e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:31.368906 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-90a1de8e-5310-4c2c-b880-5ddff7fa2f4e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:31.369605 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-90a1de8e-5310-4c2c-b880-5ddff7fa2f4e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:31.370413 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-90a1de8e-5310-4c2c-b880-5ddff7fa2f4e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:31.370855 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-90a1de8e-5310-4c2c-b880-5ddff7fa2f4e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:31.541618 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1ed41933-834d-4b5c-a8c0-6131e3f878b2 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467" status: 204 len: 0 microversion: 2.1 time: 0.358469 May 17 17:28:31.542231 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 336/727] 10.222.0.88 () {58 vars in 1238 bytes} [Tue May 17 17:28:31 2022] DELETE /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 17 17:28:31.550594 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e0e9327d-cb5c-4c5f-b2f8-4caaf2ac5f1c tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:31.556474 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e0e9327d-cb5c-4c5f-b2f8-4caaf2ac5f1c tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:31.557220 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e0e9327d-cb5c-4c5f-b2f8-4caaf2ac5f1c tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:31.557675 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e0e9327d-cb5c-4c5f-b2f8-4caaf2ac5f1c tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:31.558450 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e0e9327d-cb5c-4c5f-b2f8-4caaf2ac5f1c tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:31.558890 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e0e9327d-cb5c-4c5f-b2f8-4caaf2ac5f1c tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:31.691777 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e0e9327d-cb5c-4c5f-b2f8-4caaf2ac5f1c tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:31.699338 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e0e9327d-cb5c-4c5f-b2f8-4caaf2ac5f1c tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467" status: 200 len: 1674 microversion: 2.1 time: 0.152815 May 17 17:28:31.699932 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 337/728] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:28:31 2022] GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:28:32.011074 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-90a1de8e-5310-4c2c-b880-5ddff7fa2f4e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7/os-volume_attachments/a4f88a64-527a-40a9-9efe-004c85dcd2ac" status: 202 len: 0 microversion: 2.20 time: 0.653164 May 17 17:28:32.014668 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 392/729] 10.222.0.88 () {60 vars in 1456 bytes} [Tue May 17 17:28:31 2022] DELETE /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7/os-volume_attachments/a4f88a64-527a-40a9-9efe-004c85dcd2ac => generated 0 bytes in 657 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 17 17:28:32.066454 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-0d0ef656-e158-4dde-8fae-93bbdc3dad85 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:28:32.070674 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-0d0ef656-e158-4dde-8fae-93bbdc3dad85 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:32.072818 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0d0ef656-e158-4dde-8fae-93bbdc3dad85 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:32.073267 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0d0ef656-e158-4dde-8fae-93bbdc3dad85 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:32.074030 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0d0ef656-e158-4dde-8fae-93bbdc3dad85 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:32.074462 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0d0ef656-e158-4dde-8fae-93bbdc3dad85 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:32.449192 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-0d0ef656-e158-4dde-8fae-93bbdc3dad85 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "POST /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7/action" status: 202 len: 0 microversion: 2.20 time: 0.386346 May 17 17:28:32.450494 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 338/730] 10.222.0.88 () {62 vars in 1318 bytes} [Tue May 17 17:28:32 2022] POST /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 17:28:32.458049 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e5d6f832-4162-45fc-bece-0263639fdd7e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:32.459722 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e5d6f832-4162-45fc-bece-0263639fdd7e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:32.465933 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e5d6f832-4162-45fc-bece-0263639fdd7e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:32.466401 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e5d6f832-4162-45fc-bece-0263639fdd7e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:32.467318 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e5d6f832-4162-45fc-bece-0263639fdd7e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:32.467780 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e5d6f832-4162-45fc-bece-0263639fdd7e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:32.604479 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e5d6f832-4162-45fc-bece-0263639fdd7e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:32.612956 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e5d6f832-4162-45fc-bece-0263639fdd7e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:32.614452 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e5d6f832-4162-45fc-bece-0263639fdd7e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:32.615639 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e5d6f832-4162-45fc-bece-0263639fdd7e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1671 microversion: 2.20 time: 0.161526 May 17 17:28:32.616194 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 393/731] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:32 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 17:28:32.715827 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d749c414-5afd-4d9c-be24-690a812031d5 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:32.716427 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d749c414-5afd-4d9c-be24-690a812031d5 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:32.722701 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d749c414-5afd-4d9c-be24-690a812031d5 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:32.723156 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d749c414-5afd-4d9c-be24-690a812031d5 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:32.723979 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d749c414-5afd-4d9c-be24-690a812031d5 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:32.724424 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d749c414-5afd-4d9c-be24-690a812031d5 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:32.879383 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d749c414-5afd-4d9c-be24-690a812031d5 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:32.887422 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d749c414-5afd-4d9c-be24-690a812031d5 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467" status: 200 len: 1674 microversion: 2.1 time: 0.175399 May 17 17:28:32.888255 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 339/732] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:28:32 2022] GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467 => generated 1674 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:28:33.635568 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d6b60caa-6018-488a-a79d-b85d624bcaa8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:33.639243 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d6b60caa-6018-488a-a79d-b85d624bcaa8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:33.643893 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d6b60caa-6018-488a-a79d-b85d624bcaa8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:33.644543 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d6b60caa-6018-488a-a79d-b85d624bcaa8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:33.645527 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d6b60caa-6018-488a-a79d-b85d624bcaa8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:33.646130 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d6b60caa-6018-488a-a79d-b85d624bcaa8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:33.867370 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d6b60caa-6018-488a-a79d-b85d624bcaa8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:33.876490 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d6b60caa-6018-488a-a79d-b85d624bcaa8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:33.878031 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d6b60caa-6018-488a-a79d-b85d624bcaa8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:33.879232 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d6b60caa-6018-488a-a79d-b85d624bcaa8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1673 microversion: 2.20 time: 0.247958 May 17 17:28:33.880024 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 394/733] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:33 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1673 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:33.905551 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-83fda0f5-698b-41f3-adc0-e349f6ea79f9 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:33.906294 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-83fda0f5-698b-41f3-adc0-e349f6ea79f9 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:33.913855 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-83fda0f5-698b-41f3-adc0-e349f6ea79f9 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:33.914429 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-83fda0f5-698b-41f3-adc0-e349f6ea79f9 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:33.915449 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-83fda0f5-698b-41f3-adc0-e349f6ea79f9 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:33.916171 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-83fda0f5-698b-41f3-adc0-e349f6ea79f9 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:34.136248 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-83fda0f5-698b-41f3-adc0-e349f6ea79f9 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:34.144090 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-83fda0f5-698b-41f3-adc0-e349f6ea79f9 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467" status: 200 len: 1674 microversion: 2.1 time: 0.242880 May 17 17:28:34.153886 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 340/734] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:28:33 2022] GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467 => generated 1674 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:28:34.664192 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-b91f8695-e8c9-44cb-8ae5-bd68919898d3 req-499bd931-142d-4128-ab4a-35578ffe300b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6e24213-8701-4dc9-b4a3-c67d80b14467", "name": "network-vif-deleted", "tag": "0605af0a-eefb-479d-a501-b55e67150a94"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:28:34.675707 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-b91f8695-e8c9-44cb-8ae5-bd68919898d3 req-499bd931-142d-4128-ab4a-35578ffe300b service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:34.675707 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-b91f8695-e8c9-44cb-8ae5-bd68919898d3 req-499bd931-142d-4128-ab4a-35578ffe300b service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:34.690292 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-b91f8695-e8c9-44cb-8ae5-bd68919898d3 req-499bd931-142d-4128-ab4a-35578ffe300b service nova] Creating event network-vif-deleted:0605af0a-eefb-479d-a501-b55e67150a94 for instance b6e24213-8701-4dc9-b4a3-c67d80b14467 on hv-cinder-84214 May 17 17:28:34.696069 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-b91f8695-e8c9-44cb-8ae5-bd68919898d3 req-499bd931-142d-4128-ab4a-35578ffe300b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037389 May 17 17:28:34.696671 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 395/735] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:28:34.899927 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8df9a5df-eead-4db7-9499-87ddde0319f2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:34.901085 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8df9a5df-eead-4db7-9499-87ddde0319f2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:34.912813 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8df9a5df-eead-4db7-9499-87ddde0319f2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:34.916964 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8df9a5df-eead-4db7-9499-87ddde0319f2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:34.916964 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8df9a5df-eead-4db7-9499-87ddde0319f2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:34.916964 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8df9a5df-eead-4db7-9499-87ddde0319f2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:35.068292 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8df9a5df-eead-4db7-9499-87ddde0319f2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:35.076016 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8df9a5df-eead-4db7-9499-87ddde0319f2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:35.077501 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8df9a5df-eead-4db7-9499-87ddde0319f2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:35.078688 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8df9a5df-eead-4db7-9499-87ddde0319f2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1729 microversion: 2.20 time: 0.183012 May 17 17:28:35.084540 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 341/736] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:34 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:35.162584 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-390151a1-6219-4060-9d36-7f019bbde229 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:35.163282 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-390151a1-6219-4060-9d36-7f019bbde229 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:35.172529 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-390151a1-6219-4060-9d36-7f019bbde229 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:35.174221 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-390151a1-6219-4060-9d36-7f019bbde229 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:35.176979 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-390151a1-6219-4060-9d36-7f019bbde229 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:35.176979 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-390151a1-6219-4060-9d36-7f019bbde229 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:35.209358 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-390151a1-6219-4060-9d36-7f019bbde229 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:35.209809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-390151a1-6219-4060-9d36-7f019bbde229 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:35.212275 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-390151a1-6219-4060-9d36-7f019bbde229 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lazy-loading 'fault' on Instance uuid b6e24213-8701-4dc9-b4a3-c67d80b14467 {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:28:35.260639 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-390151a1-6219-4060-9d36-7f019bbde229 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c023452db94dd0a2eea952ae762471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc78ca5daa4d7d9df70c24b21bf8cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:35.261880 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-390151a1-6219-4060-9d36-7f019bbde229 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467" status: 200 len: 1328 microversion: 2.1 time: 0.103342 May 17 17:28:35.263150 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 396/737] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:28:35 2022] GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467 => generated 1328 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:28:36.098850 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-05e9f421-9129-48a7-be64-8ea32abf070b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:36.099564 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-05e9f421-9129-48a7-be64-8ea32abf070b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:36.106835 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-05e9f421-9129-48a7-be64-8ea32abf070b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:36.107344 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-05e9f421-9129-48a7-be64-8ea32abf070b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:36.108221 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-05e9f421-9129-48a7-be64-8ea32abf070b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:36.108818 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-05e9f421-9129-48a7-be64-8ea32abf070b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:36.292605 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-bd15ebec-6ca0-411d-b7e4-3e9ef0695816 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:36.295823 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-bd15ebec-6ca0-411d-b7e4-3e9ef0695816 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:36.307944 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-05e9f421-9129-48a7-be64-8ea32abf070b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:36.309914 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bd15ebec-6ca0-411d-b7e4-3e9ef0695816 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:36.311415 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bd15ebec-6ca0-411d-b7e4-3e9ef0695816 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:36.313025 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bd15ebec-6ca0-411d-b7e4-3e9ef0695816 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:36.314307 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bd15ebec-6ca0-411d-b7e4-3e9ef0695816 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:36.320760 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-05e9f421-9129-48a7-be64-8ea32abf070b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:36.323348 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-05e9f421-9129-48a7-be64-8ea32abf070b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:36.324840 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-05e9f421-9129-48a7-be64-8ea32abf070b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1729 microversion: 2.20 time: 0.231398 May 17 17:28:36.328178 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 342/738] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:36 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1729 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:36.348494 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-bd15ebec-6ca0-411d-b7e4-3e9ef0695816 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] HTTP exception thrown: Instance b6e24213-8701-4dc9-b4a3-c67d80b14467 could not be found. May 17 17:28:36.350474 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-bd15ebec-6ca0-411d-b7e4-3e9ef0695816 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Request method failure captured: May 17 17:28:36.350474 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: request: GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467 HTTP/1.1 May 17 17:28:36.350474 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 17 17:28:36.350474 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 17 17:28:36.350474 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Connection: close May 17 17:28:36.350474 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 17 17:28:36.350474 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 17 17:28:36.350474 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.88 May 17 17:28:36.350474 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 17 17:28:36.350474 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 17 17:28:36.350474 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABig9m7397qNk7jDJRlhyJp-yRQaZh-xj7r-i1j24ZkPQC0Mgct3usBafCVshC42M-fjeO9T6yeUpRXsAbzSZ3AzqK8y3nAjGwIayDVJmLaeqRMF0J7eJrSkRR-vUmCKfBYG_3FXZ6veNX1SOcydg0xehS60qk_AFXxHN20w1WQzwIJ2f4 May 17 17:28:36.350474 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 17 17:28:36.350474 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 17 17:28:36.350474 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 17 17:28:36.350474 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 17 17:28:36.350474 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 17 17:28:36.350474 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 17 17:28:36.350474 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Id: f2cc78ca5daa4d7d9df70c24b21bf8cf May 17 17:28:36.350474 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeTestJSON-340644429 May 17 17:28:36.350474 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Role: reader,member May 17 17:28:36.350474 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Roles: reader,member May 17 17:28:36.352082 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f2cc78ca5daa4d7d9df70c24b21bf8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f2cc78ca5daa4d7d9df70c24b21bf8cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f2cc78ca5daa4d7d9df70c24b21bf8cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f2cc78ca5daa4d7d9df70c24b21bf8cf", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:28:36.352082 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeTestJSON-340644429 May 17 17:28:36.352082 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: f2cc78ca5daa4d7d9df70c24b21bf8cf May 17 17:28:36.352082 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeTestJSON-340644429 May 17 17:28:36.352082 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeTestJSON-340644429-project May 17 17:28:36.352082 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 17 17:28:36.352082 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 17 17:28:36.352082 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Id: 19c023452db94dd0a2eea952ae762471 May 17 17:28:36.352082 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeTestJSON-340644429-project May 17 17:28:36.352082 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: method: > May 17 17:28:36.352082 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: exception: Instance b6e24213-8701-4dc9-b4a3-c67d80b14467 could not be found. May 17 17:28:36.352082 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: action_args: {'id': 'b6e24213-8701-4dc9-b4a3-c67d80b14467'} May 17 17:28:36.352872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:28:36.352872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:28:36.352872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:28:36.352872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:28:36.352872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:28:36.352872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:28:36.352872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:28:36.352872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:28:36.352872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:28:36.352872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:28:36.352872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6e24213-8701-4dc9-b4a3-c67d80b14467 could not be found. May 17 17:28:36.352872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:28:36.352872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:28:36.352872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:28:36.352872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:28:36.352872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:28:36.352872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:28:36.352872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:28:36.352872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:28:36.352872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:28:36.354160 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:28:36.354160 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:28:36.354160 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:28:36.354160 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:28:36.354160 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:28:36.354160 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:28:36.354160 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:28:36.354160 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6e24213-8701-4dc9-b4a3-c67d80b14467 could not be found. May 17 17:28:36.354160 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:28:36.354160 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:28:36.354160 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:28:36.354160 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:28:36.354160 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:28:36.354160 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:28:36.354160 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:28:36.354160 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:28:36.354160 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6e24213-8701-4dc9-b4a3-c67d80b14467 could not be found. May 17 17:28:36.354160 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:28:36.355300 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-bd15ebec-6ca0-411d-b7e4-3e9ef0695816 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Returning 404 to user: Instance b6e24213-8701-4dc9-b4a3-c67d80b14467 could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:28:36.364585 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-bd15ebec-6ca0-411d-b7e4-3e9ef0695816 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467" status: 404 len: 111 microversion: 2.1 time: 0.073177 May 17 17:28:36.365177 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 397/739] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:28:36 2022] GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:28:36.375200 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-289864aa-97c5-42ba-b8bf-af5889053ef0 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '.version_select at 0x7f73cb785f70>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:36.465308 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-289864aa-97c5-42ba-b8bf-af5889053ef0 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1764138737" status: 202 len: 0 microversion: 2.1 time: 0.094752 May 17 17:28:36.466298 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 343/740] 10.222.0.88 () {58 vars in 1220 bytes} [Tue May 17 17:28:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1764138737 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:28:37.347761 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-be849600-ef91-43a9-b8b4-868de7aa94ea tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:37.349185 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-be849600-ef91-43a9-b8b4-868de7aa94ea tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:37.357041 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-be849600-ef91-43a9-b8b4-868de7aa94ea tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:37.357502 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-be849600-ef91-43a9-b8b4-868de7aa94ea tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:37.358449 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-be849600-ef91-43a9-b8b4-868de7aa94ea tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:37.358918 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-be849600-ef91-43a9-b8b4-868de7aa94ea tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:37.543221 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-be849600-ef91-43a9-b8b4-868de7aa94ea tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:37.580425 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-be849600-ef91-43a9-b8b4-868de7aa94ea tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:37.582150 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-be849600-ef91-43a9-b8b4-868de7aa94ea tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:37.583364 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-be849600-ef91-43a9-b8b4-868de7aa94ea tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1729 microversion: 2.20 time: 0.240829 May 17 17:28:37.583949 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 398/741] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:37 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1729 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:38.602377 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6cd35920-ba80-44d9-8f5a-d34ab498f29f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:38.604348 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6cd35920-ba80-44d9-8f5a-d34ab498f29f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:38.613288 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6cd35920-ba80-44d9-8f5a-d34ab498f29f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:38.614210 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6cd35920-ba80-44d9-8f5a-d34ab498f29f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:38.615631 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6cd35920-ba80-44d9-8f5a-d34ab498f29f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:38.616295 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6cd35920-ba80-44d9-8f5a-d34ab498f29f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:38.790854 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6cd35920-ba80-44d9-8f5a-d34ab498f29f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:38.800421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6cd35920-ba80-44d9-8f5a-d34ab498f29f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:38.805070 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6cd35920-ba80-44d9-8f5a-d34ab498f29f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:38.808657 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6cd35920-ba80-44d9-8f5a-d34ab498f29f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1729 microversion: 2.20 time: 0.208689 May 17 17:28:38.808657 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 344/742] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:38 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:39.825494 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-caa2ea1a-f32a-49ba-8daa-0f6179363348 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:39.826103 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-caa2ea1a-f32a-49ba-8daa-0f6179363348 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:39.832643 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-caa2ea1a-f32a-49ba-8daa-0f6179363348 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:39.833191 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-caa2ea1a-f32a-49ba-8daa-0f6179363348 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:39.834189 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-caa2ea1a-f32a-49ba-8daa-0f6179363348 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:39.834797 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-caa2ea1a-f32a-49ba-8daa-0f6179363348 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:39.978517 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-caa2ea1a-f32a-49ba-8daa-0f6179363348 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:39.988919 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-caa2ea1a-f32a-49ba-8daa-0f6179363348 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:39.990847 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-caa2ea1a-f32a-49ba-8daa-0f6179363348 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:39.992709 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-caa2ea1a-f32a-49ba-8daa-0f6179363348 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1729 microversion: 2.20 time: 0.170462 May 17 17:28:40.003871 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 399/743] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:39 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:40.009927 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-acea33e4-ad87-4d74-b46e-13240693252d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:40.010498 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-acea33e4-ad87-4d74-b46e-13240693252d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:40.018344 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-acea33e4-ad87-4d74-b46e-13240693252d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:40.019143 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-acea33e4-ad87-4d74-b46e-13240693252d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:40.020199 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-acea33e4-ad87-4d74-b46e-13240693252d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:40.020898 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-acea33e4-ad87-4d74-b46e-13240693252d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:40.040715 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-acea33e4-ad87-4d74-b46e-13240693252d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] HTTP exception thrown: Instance b6e24213-8701-4dc9-b4a3-c67d80b14467 could not be found. May 17 17:28:40.042841 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-acea33e4-ad87-4d74-b46e-13240693252d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Request method failure captured: May 17 17:28:40.042841 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: DELETE /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467 HTTP/1.1 May 17 17:28:40.042841 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:28:40.042841 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:28:40.042841 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:28:40.042841 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:28:40.042841 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:28:40.042841 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:28:40.042841 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:28:40.042841 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:28:40.042841 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9m7397qNk7jDJRlhyJp-yRQaZh-xj7r-i1j24ZkPQC0Mgct3usBafCVshC42M-fjeO9T6yeUpRXsAbzSZ3AzqK8y3nAjGwIayDVJmLaeqRMF0J7eJrSkRR-vUmCKfBYG_3FXZ6veNX1SOcydg0xehS60qk_AFXxHN20w1WQzwIJ2f4 May 17 17:28:40.042841 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:28:40.042841 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:28:40.042841 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:28:40.042841 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:28:40.042841 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:28:40.042841 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:28:40.042841 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: f2cc78ca5daa4d7d9df70c24b21bf8cf May 17 17:28:40.042841 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-AttachVolumeTestJSON-340644429 May 17 17:28:40.042841 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:28:40.042841 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:28:40.045006 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f2cc78ca5daa4d7d9df70c24b21bf8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f2cc78ca5daa4d7d9df70c24b21bf8cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f2cc78ca5daa4d7d9df70c24b21bf8cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f2cc78ca5daa4d7d9df70c24b21bf8cf", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:28:40.045006 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-AttachVolumeTestJSON-340644429 May 17 17:28:40.045006 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: f2cc78ca5daa4d7d9df70c24b21bf8cf May 17 17:28:40.045006 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-AttachVolumeTestJSON-340644429 May 17 17:28:40.045006 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-AttachVolumeTestJSON-340644429-project May 17 17:28:40.045006 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:28:40.045006 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:28:40.045006 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 19c023452db94dd0a2eea952ae762471 May 17 17:28:40.045006 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-AttachVolumeTestJSON-340644429-project May 17 17:28:40.045006 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:28:40.045006 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Instance b6e24213-8701-4dc9-b4a3-c67d80b14467 could not be found. May 17 17:28:40.045006 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': 'b6e24213-8701-4dc9-b4a3-c67d80b14467'} May 17 17:28:40.046034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:28:40.046034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:28:40.046034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:28:40.046034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:28:40.046034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:28:40.046034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:28:40.046034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:28:40.046034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:28:40.046034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:28:40.046034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:28:40.046034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6e24213-8701-4dc9-b4a3-c67d80b14467 could not be found. May 17 17:28:40.046034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:28:40.046034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:28:40.046034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:28:40.046034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:28:40.046034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:28:40.046034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:28:40.046034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:28:40.046034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:28:40.046034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:28:40.048911 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:28:40.048911 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 17:28:40.048911 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 17:28:40.048911 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 17:28:40.048911 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 17:28:40.048911 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:28:40.048911 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:28:40.048911 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:28:40.048911 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:28:40.048911 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6e24213-8701-4dc9-b4a3-c67d80b14467 could not be found. May 17 17:28:40.048911 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:28:40.048911 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:28:40.048911 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:28:40.048911 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:28:40.048911 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:28:40.048911 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:28:40.048911 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:28:40.048911 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:28:40.048911 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6e24213-8701-4dc9-b4a3-c67d80b14467 could not be found. May 17 17:28:40.048911 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:28:40.052120 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-acea33e4-ad87-4d74-b46e-13240693252d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Returning 404 to user: Instance b6e24213-8701-4dc9-b4a3-c67d80b14467 could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:28:40.053165 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-acea33e4-ad87-4d74-b46e-13240693252d tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467" status: 404 len: 111 microversion: 2.1 time: 0.047169 May 17 17:28:40.054206 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 345/744] 10.222.0.88 () {58 vars in 1238 bytes} [Tue May 17 17:28:40 2022] DELETE /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 17:28:40.062182 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0653bf38-6cda-417d-9d6d-a619bf2d4482 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:40.062908 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0653bf38-6cda-417d-9d6d-a619bf2d4482 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: b6e24213-8701-4dc9-b4a3-c67d80b14467] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:40.069105 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0653bf38-6cda-417d-9d6d-a619bf2d4482 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:40.069881 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0653bf38-6cda-417d-9d6d-a619bf2d4482 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:40.070906 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0653bf38-6cda-417d-9d6d-a619bf2d4482 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:40.071796 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0653bf38-6cda-417d-9d6d-a619bf2d4482 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:40.088835 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-0653bf38-6cda-417d-9d6d-a619bf2d4482 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] HTTP exception thrown: Instance b6e24213-8701-4dc9-b4a3-c67d80b14467 could not be found. May 17 17:28:40.090471 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0653bf38-6cda-417d-9d6d-a619bf2d4482 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Request method failure captured: May 17 17:28:40.090471 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: request: GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467 HTTP/1.1 May 17 17:28:40.090471 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 17 17:28:40.090471 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 17 17:28:40.090471 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Connection: close May 17 17:28:40.090471 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 17 17:28:40.090471 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 17 17:28:40.090471 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.88 May 17 17:28:40.090471 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 17 17:28:40.090471 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 17 17:28:40.090471 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABig9m7397qNk7jDJRlhyJp-yRQaZh-xj7r-i1j24ZkPQC0Mgct3usBafCVshC42M-fjeO9T6yeUpRXsAbzSZ3AzqK8y3nAjGwIayDVJmLaeqRMF0J7eJrSkRR-vUmCKfBYG_3FXZ6veNX1SOcydg0xehS60qk_AFXxHN20w1WQzwIJ2f4 May 17 17:28:40.090471 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 17 17:28:40.090471 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 17 17:28:40.090471 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 17 17:28:40.090471 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 17 17:28:40.090471 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 17 17:28:40.090471 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 17 17:28:40.090471 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Id: f2cc78ca5daa4d7d9df70c24b21bf8cf May 17 17:28:40.090471 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeTestJSON-340644429 May 17 17:28:40.090471 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Role: reader,member May 17 17:28:40.090471 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Roles: reader,member May 17 17:28:40.091899 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f2cc78ca5daa4d7d9df70c24b21bf8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f2cc78ca5daa4d7d9df70c24b21bf8cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f2cc78ca5daa4d7d9df70c24b21bf8cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f2cc78ca5daa4d7d9df70c24b21bf8cf", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:28:40.091899 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeTestJSON-340644429 May 17 17:28:40.091899 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: f2cc78ca5daa4d7d9df70c24b21bf8cf May 17 17:28:40.091899 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeTestJSON-340644429 May 17 17:28:40.091899 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeTestJSON-340644429-project May 17 17:28:40.091899 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 17 17:28:40.091899 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 17 17:28:40.091899 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Id: 19c023452db94dd0a2eea952ae762471 May 17 17:28:40.091899 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeTestJSON-340644429-project May 17 17:28:40.091899 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: method: > May 17 17:28:40.091899 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: exception: Instance b6e24213-8701-4dc9-b4a3-c67d80b14467 could not be found. May 17 17:28:40.091899 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: action_args: {'id': 'b6e24213-8701-4dc9-b4a3-c67d80b14467'} May 17 17:28:40.092662 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:28:40.092662 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:28:40.092662 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:28:40.092662 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:28:40.092662 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:28:40.092662 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:28:40.092662 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:28:40.092662 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:28:40.092662 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:28:40.092662 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:28:40.092662 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6e24213-8701-4dc9-b4a3-c67d80b14467 could not be found. May 17 17:28:40.092662 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:28:40.092662 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:28:40.092662 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:28:40.092662 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:28:40.092662 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:28:40.092662 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:28:40.092662 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:28:40.092662 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:28:40.092662 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:28:40.093976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:28:40.093976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:28:40.093976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:28:40.093976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:28:40.093976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:28:40.093976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:28:40.093976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:28:40.093976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6e24213-8701-4dc9-b4a3-c67d80b14467 could not be found. May 17 17:28:40.093976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:28:40.093976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:28:40.093976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:28:40.093976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:28:40.093976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:28:40.093976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:28:40.093976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:28:40.093976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:28:40.093976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6e24213-8701-4dc9-b4a3-c67d80b14467 could not be found. May 17 17:28:40.093976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:28:40.101884 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0653bf38-6cda-417d-9d6d-a619bf2d4482 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Returning 404 to user: Instance b6e24213-8701-4dc9-b4a3-c67d80b14467 could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:28:40.101884 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0653bf38-6cda-417d-9d6d-a619bf2d4482 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467" status: 404 len: 111 microversion: 2.1 time: 0.033909 May 17 17:28:40.101884 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 400/745] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:28:40 2022] GET /compute/v2.1/servers/b6e24213-8701-4dc9-b4a3-c67d80b14467 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:28:41.010791 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-461a5dec-48d3-4a0e-a7fa-01efb11f018b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:41.011709 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-461a5dec-48d3-4a0e-a7fa-01efb11f018b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:41.019566 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-461a5dec-48d3-4a0e-a7fa-01efb11f018b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:41.020045 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-461a5dec-48d3-4a0e-a7fa-01efb11f018b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:41.021139 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-461a5dec-48d3-4a0e-a7fa-01efb11f018b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:41.021596 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-461a5dec-48d3-4a0e-a7fa-01efb11f018b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:41.157737 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-461a5dec-48d3-4a0e-a7fa-01efb11f018b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:41.166151 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-461a5dec-48d3-4a0e-a7fa-01efb11f018b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:41.167934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-461a5dec-48d3-4a0e-a7fa-01efb11f018b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:41.169133 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-461a5dec-48d3-4a0e-a7fa-01efb11f018b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1729 microversion: 2.20 time: 0.162815 May 17 17:28:41.169741 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 346/746] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:41 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:41.365524 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1fd2af4d-00e3-4c68-a63b-d4e24f47478a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:41.366016 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1fd2af4d-00e3-4c68-a63b-d4e24f47478a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:41.372027 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1fd2af4d-00e3-4c68-a63b-d4e24f47478a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:41.374471 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1fd2af4d-00e3-4c68-a63b-d4e24f47478a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:41.374471 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1fd2af4d-00e3-4c68-a63b-d4e24f47478a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:41.374471 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1fd2af4d-00e3-4c68-a63b-d4e24f47478a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:41.407584 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-1fd2af4d-00e3-4c68-a63b-d4e24f47478a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] HTTP exception thrown: Instance 3a87018c-9e2f-4322-8472-dbe43085332f could not be found. May 17 17:28:41.409306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1fd2af4d-00e3-4c68-a63b-d4e24f47478a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Request method failure captured: May 17 17:28:41.409306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: request: DELETE /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f HTTP/1.1 May 17 17:28:41.409306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 17 17:28:41.409306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 17 17:28:41.409306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Connection: close May 17 17:28:41.409306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 17 17:28:41.409306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 17 17:28:41.409306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.88 May 17 17:28:41.409306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 17 17:28:41.409306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 17 17:28:41.409306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABig9m7397qNk7jDJRlhyJp-yRQaZh-xj7r-i1j24ZkPQC0Mgct3usBafCVshC42M-fjeO9T6yeUpRXsAbzSZ3AzqK8y3nAjGwIayDVJmLaeqRMF0J7eJrSkRR-vUmCKfBYG_3FXZ6veNX1SOcydg0xehS60qk_AFXxHN20w1WQzwIJ2f4 May 17 17:28:41.409306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 17 17:28:41.409306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 17 17:28:41.409306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 17 17:28:41.409306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 17 17:28:41.409306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 17 17:28:41.409306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 17 17:28:41.409306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Id: f2cc78ca5daa4d7d9df70c24b21bf8cf May 17 17:28:41.409306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeTestJSON-340644429 May 17 17:28:41.409306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Role: reader,member May 17 17:28:41.409306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Roles: reader,member May 17 17:28:41.411168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f2cc78ca5daa4d7d9df70c24b21bf8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f2cc78ca5daa4d7d9df70c24b21bf8cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f2cc78ca5daa4d7d9df70c24b21bf8cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f2cc78ca5daa4d7d9df70c24b21bf8cf", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:28:41.411168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeTestJSON-340644429 May 17 17:28:41.411168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: f2cc78ca5daa4d7d9df70c24b21bf8cf May 17 17:28:41.411168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeTestJSON-340644429 May 17 17:28:41.411168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeTestJSON-340644429-project May 17 17:28:41.411168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 17 17:28:41.411168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 17 17:28:41.411168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Id: 19c023452db94dd0a2eea952ae762471 May 17 17:28:41.411168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeTestJSON-340644429-project May 17 17:28:41.411168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: method: > May 17 17:28:41.411168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: exception: Instance 3a87018c-9e2f-4322-8472-dbe43085332f could not be found. May 17 17:28:41.411168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: action_args: {'id': '3a87018c-9e2f-4322-8472-dbe43085332f'} May 17 17:28:41.412488 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:28:41.412488 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:28:41.412488 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:28:41.412488 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:28:41.412488 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:28:41.412488 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:28:41.412488 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:28:41.412488 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:28:41.412488 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:28:41.412488 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:28:41.412488 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a87018c-9e2f-4322-8472-dbe43085332f could not be found. May 17 17:28:41.412488 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:28:41.412488 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:28:41.412488 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:28:41.412488 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:28:41.412488 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:28:41.412488 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:28:41.412488 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:28:41.412488 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:28:41.412488 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:28:41.414115 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:28:41.414115 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 17:28:41.414115 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 17:28:41.414115 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 17:28:41.414115 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 17:28:41.414115 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:28:41.414115 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:28:41.414115 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:28:41.414115 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:28:41.414115 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a87018c-9e2f-4322-8472-dbe43085332f could not be found. May 17 17:28:41.414115 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:28:41.414115 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:28:41.414115 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:28:41.414115 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:28:41.414115 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:28:41.414115 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:28:41.414115 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:28:41.414115 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:28:41.414115 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a87018c-9e2f-4322-8472-dbe43085332f could not be found. May 17 17:28:41.414115 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:28:41.416384 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1fd2af4d-00e3-4c68-a63b-d4e24f47478a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Returning 404 to user: Instance 3a87018c-9e2f-4322-8472-dbe43085332f could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:28:41.416384 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1fd2af4d-00e3-4c68-a63b-d4e24f47478a tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 404 len: 111 microversion: 2.1 time: 0.049184 May 17 17:28:41.416384 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 401/747] 10.222.0.88 () {58 vars in 1238 bytes} [Tue May 17 17:28:41 2022] DELETE /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:28:41.419622 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e7e8135b-06c8-4035-9e4d-5ee3fc79a9d8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:41.420233 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e7e8135b-06c8-4035-9e4d-5ee3fc79a9d8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] [instance: 3a87018c-9e2f-4322-8472-dbe43085332f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:41.427362 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e7e8135b-06c8-4035-9e4d-5ee3fc79a9d8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:41.428083 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e7e8135b-06c8-4035-9e4d-5ee3fc79a9d8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:41.428915 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e7e8135b-06c8-4035-9e4d-5ee3fc79a9d8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:41.429320 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e7e8135b-06c8-4035-9e4d-5ee3fc79a9d8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:41.461998 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-e7e8135b-06c8-4035-9e4d-5ee3fc79a9d8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] HTTP exception thrown: Instance 3a87018c-9e2f-4322-8472-dbe43085332f could not be found. May 17 17:28:41.466223 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e7e8135b-06c8-4035-9e4d-5ee3fc79a9d8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Request method failure captured: May 17 17:28:41.466223 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f HTTP/1.1 May 17 17:28:41.466223 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:28:41.466223 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:28:41.466223 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:28:41.466223 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:28:41.466223 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:28:41.466223 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:28:41.466223 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:28:41.466223 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:28:41.466223 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9m7397qNk7jDJRlhyJp-yRQaZh-xj7r-i1j24ZkPQC0Mgct3usBafCVshC42M-fjeO9T6yeUpRXsAbzSZ3AzqK8y3nAjGwIayDVJmLaeqRMF0J7eJrSkRR-vUmCKfBYG_3FXZ6veNX1SOcydg0xehS60qk_AFXxHN20w1WQzwIJ2f4 May 17 17:28:41.466223 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:28:41.466223 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:28:41.466223 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:28:41.466223 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:28:41.466223 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:28:41.466223 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:28:41.466223 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: f2cc78ca5daa4d7d9df70c24b21bf8cf May 17 17:28:41.466223 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-AttachVolumeTestJSON-340644429 May 17 17:28:41.466223 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:28:41.466223 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:28:41.467795 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f2cc78ca5daa4d7d9df70c24b21bf8cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f2cc78ca5daa4d7d9df70c24b21bf8cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f2cc78ca5daa4d7d9df70c24b21bf8cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f2cc78ca5daa4d7d9df70c24b21bf8cf", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:28:41.467795 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-AttachVolumeTestJSON-340644429 May 17 17:28:41.467795 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: f2cc78ca5daa4d7d9df70c24b21bf8cf May 17 17:28:41.467795 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-AttachVolumeTestJSON-340644429 May 17 17:28:41.467795 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-AttachVolumeTestJSON-340644429-project May 17 17:28:41.467795 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:28:41.467795 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:28:41.467795 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 19c023452db94dd0a2eea952ae762471 May 17 17:28:41.467795 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-AttachVolumeTestJSON-340644429-project May 17 17:28:41.467795 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:28:41.467795 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Instance 3a87018c-9e2f-4322-8472-dbe43085332f could not be found. May 17 17:28:41.467795 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': '3a87018c-9e2f-4322-8472-dbe43085332f'} May 17 17:28:41.468561 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:28:41.468561 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:28:41.468561 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:28:41.468561 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:28:41.468561 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:28:41.468561 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:28:41.468561 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:28:41.468561 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:28:41.468561 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:28:41.468561 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:28:41.468561 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a87018c-9e2f-4322-8472-dbe43085332f could not be found. May 17 17:28:41.468561 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:28:41.468561 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:28:41.468561 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:28:41.468561 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:28:41.468561 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:28:41.468561 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:28:41.468561 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:28:41.468561 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:28:41.468561 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:28:41.469825 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:28:41.469825 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:28:41.469825 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:28:41.469825 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:28:41.469825 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:28:41.469825 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:28:41.469825 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:28:41.469825 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a87018c-9e2f-4322-8472-dbe43085332f could not be found. May 17 17:28:41.469825 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:28:41.469825 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:28:41.469825 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:28:41.469825 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:28:41.469825 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:28:41.469825 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:28:41.469825 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:28:41.469825 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:28:41.469825 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a87018c-9e2f-4322-8472-dbe43085332f could not be found. May 17 17:28:41.469825 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:28:41.471233 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e7e8135b-06c8-4035-9e4d-5ee3fc79a9d8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] Returning 404 to user: Instance 3a87018c-9e2f-4322-8472-dbe43085332f could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:28:41.471233 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e7e8135b-06c8-4035-9e4d-5ee3fc79a9d8 tempest-AttachVolumeTestJSON-340644429 tempest-AttachVolumeTestJSON-340644429-project] 10.222.0.88 "GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f" status: 404 len: 111 microversion: 2.1 time: 0.049671 May 17 17:28:41.471233 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 347/748] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:28:41 2022] GET /compute/v2.1/servers/3a87018c-9e2f-4322-8472-dbe43085332f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 17:28:42.186878 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-9b5bc859-6ac0-47c7-b684-b8615438237f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:42.187618 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-9b5bc859-6ac0-47c7-b684-b8615438237f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:42.193998 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9b5bc859-6ac0-47c7-b684-b8615438237f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:42.197877 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9b5bc859-6ac0-47c7-b684-b8615438237f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:42.197877 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9b5bc859-6ac0-47c7-b684-b8615438237f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:42.197877 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9b5bc859-6ac0-47c7-b684-b8615438237f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:42.567919 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-9b5bc859-6ac0-47c7-b684-b8615438237f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:42.567919 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-9b5bc859-6ac0-47c7-b684-b8615438237f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:42.571616 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-9b5bc859-6ac0-47c7-b684-b8615438237f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:42.571616 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-9b5bc859-6ac0-47c7-b684-b8615438237f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1729 microversion: 2.20 time: 0.278505 May 17 17:28:42.571616 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 402/749] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:42 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1729 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:43.484850 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-95caa174-fc0d-4ba5-8991-db6c3b4c709a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:43.487467 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-95caa174-fc0d-4ba5-8991-db6c3b4c709a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:43.496769 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-95caa174-fc0d-4ba5-8991-db6c3b4c709a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:43.497713 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-95caa174-fc0d-4ba5-8991-db6c3b4c709a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:43.500259 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-95caa174-fc0d-4ba5-8991-db6c3b4c709a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:43.501991 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-95caa174-fc0d-4ba5-8991-db6c3b4c709a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:43.700352 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-95caa174-fc0d-4ba5-8991-db6c3b4c709a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:43.711452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-95caa174-fc0d-4ba5-8991-db6c3b4c709a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:43.713237 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-95caa174-fc0d-4ba5-8991-db6c3b4c709a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:43.714696 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-95caa174-fc0d-4ba5-8991-db6c3b4c709a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1729 microversion: 2.20 time: 0.237851 May 17 17:28:43.726267 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 348/750] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:43 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1729 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:44.733748 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-486b35c8-8dfa-4505-8a20-48086451ddf2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:44.859350 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-486b35c8-8dfa-4505-8a20-48086451ddf2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:44.859350 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-486b35c8-8dfa-4505-8a20-48086451ddf2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:44.859350 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-486b35c8-8dfa-4505-8a20-48086451ddf2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:44.859350 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-486b35c8-8dfa-4505-8a20-48086451ddf2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:44.860983 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-486b35c8-8dfa-4505-8a20-48086451ddf2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:44.880336 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-486b35c8-8dfa-4505-8a20-48086451ddf2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:44.890829 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-486b35c8-8dfa-4505-8a20-48086451ddf2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:44.893294 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-486b35c8-8dfa-4505-8a20-48086451ddf2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:44.894690 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-486b35c8-8dfa-4505-8a20-48086451ddf2 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1729 microversion: 2.20 time: 0.164868 May 17 17:28:44.895424 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 403/751] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:44 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:45.914571 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-19f35a29-ae24-49c7-bc27-045b29437074 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:45.917823 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-19f35a29-ae24-49c7-bc27-045b29437074 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:45.923684 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-19f35a29-ae24-49c7-bc27-045b29437074 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:45.924238 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-19f35a29-ae24-49c7-bc27-045b29437074 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:45.925118 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-19f35a29-ae24-49c7-bc27-045b29437074 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:45.925560 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-19f35a29-ae24-49c7-bc27-045b29437074 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:46.124980 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-19f35a29-ae24-49c7-bc27-045b29437074 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:46.133992 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-19f35a29-ae24-49c7-bc27-045b29437074 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:46.136022 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-19f35a29-ae24-49c7-bc27-045b29437074 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:46.137174 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-19f35a29-ae24-49c7-bc27-045b29437074 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1729 microversion: 2.20 time: 0.227630 May 17 17:28:46.137719 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 349/752] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:45 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1729 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:47.155062 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-121a34ba-555f-4e10-8bc4-71cf29455eb8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:47.158839 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-121a34ba-555f-4e10-8bc4-71cf29455eb8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:47.162562 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-121a34ba-555f-4e10-8bc4-71cf29455eb8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:47.163068 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-121a34ba-555f-4e10-8bc4-71cf29455eb8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:47.163922 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-121a34ba-555f-4e10-8bc4-71cf29455eb8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:47.164483 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-121a34ba-555f-4e10-8bc4-71cf29455eb8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:47.309008 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-121a34ba-555f-4e10-8bc4-71cf29455eb8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:47.318445 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-121a34ba-555f-4e10-8bc4-71cf29455eb8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:47.319910 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-121a34ba-555f-4e10-8bc4-71cf29455eb8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:47.321082 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-121a34ba-555f-4e10-8bc4-71cf29455eb8 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1729 microversion: 2.20 time: 0.169860 May 17 17:28:47.321851 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 404/753] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:47 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:48.339912 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-2d73d480-44ef-4941-8d30-ba777a2d0042 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:48.340588 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-2d73d480-44ef-4941-8d30-ba777a2d0042 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:48.346897 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2d73d480-44ef-4941-8d30-ba777a2d0042 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:48.347344 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2d73d480-44ef-4941-8d30-ba777a2d0042 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:48.348146 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2d73d480-44ef-4941-8d30-ba777a2d0042 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:48.348585 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2d73d480-44ef-4941-8d30-ba777a2d0042 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:48.476875 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2d73d480-44ef-4941-8d30-ba777a2d0042 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:48.484604 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2d73d480-44ef-4941-8d30-ba777a2d0042 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:48.489482 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2d73d480-44ef-4941-8d30-ba777a2d0042 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:48.489482 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-2d73d480-44ef-4941-8d30-ba777a2d0042 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1729 microversion: 2.20 time: 0.151120 May 17 17:28:48.489482 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 350/754] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:48 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:49.424132 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-1e0a83d9-fc6c-4ede-a928-b0f4638a6e63 req-d7a2a65d-fe2a-4bf1-b644-f0b1a56da85d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c833b0fb-2150-403e-a166-d5b80f2025f7", "name": "network-vif-plugged", "status": "completed", "tag": "ecb996fe-261e-4301-b89c-b7a116cf273b"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:28:49.432329 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-1e0a83d9-fc6c-4ede-a928-b0f4638a6e63 req-d7a2a65d-fe2a-4bf1-b644-f0b1a56da85d service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:49.432773 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-1e0a83d9-fc6c-4ede-a928-b0f4638a6e63 req-d7a2a65d-fe2a-4bf1-b644-f0b1a56da85d service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:49.448079 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-1e0a83d9-fc6c-4ede-a928-b0f4638a6e63 req-d7a2a65d-fe2a-4bf1-b644-f0b1a56da85d service nova] Creating event network-vif-plugged:ecb996fe-261e-4301-b89c-b7a116cf273b for instance c833b0fb-2150-403e-a166-d5b80f2025f7 on hv-cinder-84214 May 17 17:28:49.448634 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-1e0a83d9-fc6c-4ede-a928-b0f4638a6e63 req-d7a2a65d-fe2a-4bf1-b644-f0b1a56da85d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028192 May 17 17:28:49.449207 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 405/755] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:28:49.506271 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-78b58401-9d57-4058-a27a-e756af4bda29 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:49.507500 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-78b58401-9d57-4058-a27a-e756af4bda29 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:49.514021 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-78b58401-9d57-4058-a27a-e756af4bda29 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:49.514464 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-78b58401-9d57-4058-a27a-e756af4bda29 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:49.515224 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-78b58401-9d57-4058-a27a-e756af4bda29 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:49.515714 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-78b58401-9d57-4058-a27a-e756af4bda29 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:49.666113 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-78b58401-9d57-4058-a27a-e756af4bda29 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:49.675768 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-78b58401-9d57-4058-a27a-e756af4bda29 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:49.677302 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-78b58401-9d57-4058-a27a-e756af4bda29 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:49.678487 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-78b58401-9d57-4058-a27a-e756af4bda29 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1729 microversion: 2.20 time: 0.176208 May 17 17:28:49.679360 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 351/756] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:49 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:50.698799 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-61a1635c-5df5-4e54-85ce-20724c7a1f95 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:50.699726 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-61a1635c-5df5-4e54-85ce-20724c7a1f95 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:50.711036 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-61a1635c-5df5-4e54-85ce-20724c7a1f95 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:50.712018 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-61a1635c-5df5-4e54-85ce-20724c7a1f95 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:50.713786 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-61a1635c-5df5-4e54-85ce-20724c7a1f95 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:50.715070 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-61a1635c-5df5-4e54-85ce-20724c7a1f95 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:50.866021 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-61a1635c-5df5-4e54-85ce-20724c7a1f95 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:50.874416 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-61a1635c-5df5-4e54-85ce-20724c7a1f95 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:50.878958 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-61a1635c-5df5-4e54-85ce-20724c7a1f95 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:50.878958 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-61a1635c-5df5-4e54-85ce-20724c7a1f95 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1729 microversion: 2.20 time: 0.184252 May 17 17:28:50.878958 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 406/757] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:50 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:51.557278 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-358ee458-394e-45dc-8bc1-58946b6d4d73 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:51.557278 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-358ee458-394e-45dc-8bc1-58946b6d4d73 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: d8ed82ef-aec7-43db-9bc8-7f925f7e75cb] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:51.564874 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-358ee458-394e-45dc-8bc1-58946b6d4d73 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:51.565328 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-358ee458-394e-45dc-8bc1-58946b6d4d73 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:51.566113 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-358ee458-394e-45dc-8bc1-58946b6d4d73 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:51.566888 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-358ee458-394e-45dc-8bc1-58946b6d4d73 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:51.606772 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-358ee458-394e-45dc-8bc1-58946b6d4d73 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: d8ed82ef-aec7-43db-9bc8-7f925f7e75cb] Going to try to terminate instance {{(pid=117611) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:28:51.896645 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-12308e3b-d955-4f34-8c8b-d0053b2e125b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:51.897463 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-12308e3b-d955-4f34-8c8b-d0053b2e125b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:51.932896 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-12308e3b-d955-4f34-8c8b-d0053b2e125b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:51.937302 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-12308e3b-d955-4f34-8c8b-d0053b2e125b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:51.939506 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-12308e3b-d955-4f34-8c8b-d0053b2e125b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:51.941363 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-12308e3b-d955-4f34-8c8b-d0053b2e125b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:52.013717 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-358ee458-394e-45dc-8bc1-58946b6d4d73 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb" status: 204 len: 0 microversion: 2.1 time: 0.461399 May 17 17:28:52.017128 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 352/758] 10.222.0.88 () {58 vars in 1238 bytes} [Tue May 17 17:28:51 2022] DELETE /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:28:52.027170 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-faf5d046-186a-4d6b-9826-56dd14183a15 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:52.028217 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-faf5d046-186a-4d6b-9826-56dd14183a15 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: d8ed82ef-aec7-43db-9bc8-7f925f7e75cb] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:52.042813 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-faf5d046-186a-4d6b-9826-56dd14183a15 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:52.043571 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-faf5d046-186a-4d6b-9826-56dd14183a15 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:52.044529 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-faf5d046-186a-4d6b-9826-56dd14183a15 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:52.046353 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-faf5d046-186a-4d6b-9826-56dd14183a15 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:52.325385 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-12308e3b-d955-4f34-8c8b-d0053b2e125b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:52.339137 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-12308e3b-d955-4f34-8c8b-d0053b2e125b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:52.341941 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-12308e3b-d955-4f34-8c8b-d0053b2e125b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:52.345400 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-12308e3b-d955-4f34-8c8b-d0053b2e125b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1729 microversion: 2.20 time: 0.452640 May 17 17:28:52.349555 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-faf5d046-186a-4d6b-9826-56dd14183a15 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:52.361486 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 407/759] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:51 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1729 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:52.362952 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-faf5d046-186a-4d6b-9826-56dd14183a15 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb" status: 200 len: 1575 microversion: 2.1 time: 0.340130 May 17 17:28:52.379994 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 353/760] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:28:52 2022] GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb => generated 1575 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:28:53.384573 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e6c7db78-c429-4387-88bc-bb5a4b79c280 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:53.385258 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e6c7db78-c429-4387-88bc-bb5a4b79c280 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: d8ed82ef-aec7-43db-9bc8-7f925f7e75cb] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:53.386394 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1a2cbcec-1b5a-4053-8ef7-606fa43606fc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:53.387478 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1a2cbcec-1b5a-4053-8ef7-606fa43606fc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:53.403621 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1a2cbcec-1b5a-4053-8ef7-606fa43606fc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:53.404578 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1a2cbcec-1b5a-4053-8ef7-606fa43606fc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:53.405694 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1a2cbcec-1b5a-4053-8ef7-606fa43606fc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:53.406515 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1a2cbcec-1b5a-4053-8ef7-606fa43606fc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:53.414421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e6c7db78-c429-4387-88bc-bb5a4b79c280 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:53.424664 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e6c7db78-c429-4387-88bc-bb5a4b79c280 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:53.428021 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e6c7db78-c429-4387-88bc-bb5a4b79c280 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:53.428709 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e6c7db78-c429-4387-88bc-bb5a4b79c280 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:53.747388 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1a2cbcec-1b5a-4053-8ef7-606fa43606fc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:53.762704 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1a2cbcec-1b5a-4053-8ef7-606fa43606fc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:53.768873 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1a2cbcec-1b5a-4053-8ef7-606fa43606fc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:53.771836 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1a2cbcec-1b5a-4053-8ef7-606fa43606fc tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1729 microversion: 2.20 time: 0.397532 May 17 17:28:53.784921 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 408/761] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:53 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1729 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:53.836712 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e6c7db78-c429-4387-88bc-bb5a4b79c280 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:53.850100 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e6c7db78-c429-4387-88bc-bb5a4b79c280 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb" status: 200 len: 1575 microversion: 2.1 time: 0.471139 May 17 17:28:53.850857 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 354/762] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:28:53 2022] GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb => generated 1575 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:28:54.803939 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2d83b233-7ef4-442e-9f6b-2c636528eb2f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:54.805232 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2d83b233-7ef4-442e-9f6b-2c636528eb2f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:54.814684 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2d83b233-7ef4-442e-9f6b-2c636528eb2f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:54.815398 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2d83b233-7ef4-442e-9f6b-2c636528eb2f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:54.816383 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2d83b233-7ef4-442e-9f6b-2c636528eb2f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:54.816976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2d83b233-7ef4-442e-9f6b-2c636528eb2f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:55.008756 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-70550a49-6626-4138-8371-3504ec608f03 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Action: 'create', calling method: .version_select at 0x7f73cb6a2c10>, body: {"keypair": {"name": "tempest-keypair-948066528", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+bCCL+qoCLXTTmdhlXDl55bDhTsxkKMQMcXSlLKCn3WSEGmQW0cadb9zusOXl/+OJVBjBH2i1PSa2iY9T1PoMthGJ7rRlKuyEElC6X6LqRj/EIV+VyQ0FzA6YzlkwOjQ=="}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:28:55.027879 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-70550a49-6626-4138-8371-3504ec608f03 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Getting quotas for project ed4b8b6a551347b6a920e4cfb59b9480. Resources: {'key_pairs'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:28:55.032672 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-70550a49-6626-4138-8371-3504ec608f03 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Getting quotas for user 7b22bf1b41774f64b7a380d86ef3f72e and project ed4b8b6a551347b6a920e4cfb59b9480. Resources: {'key_pairs'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:28:55.070874 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2d83b233-7ef4-442e-9f6b-2c636528eb2f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:55.082253 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2d83b233-7ef4-442e-9f6b-2c636528eb2f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:55.084462 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2d83b233-7ef4-442e-9f6b-2c636528eb2f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:55.085859 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2d83b233-7ef4-442e-9f6b-2c636528eb2f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1716 microversion: 2.20 time: 0.287408 May 17 17:28:55.086687 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 409/763] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:28:54 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1716 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:28:55.096343 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1617cb62-d41c-4260-85fe-8166d03a85f8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:55.098634 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1617cb62-d41c-4260-85fe-8166d03a85f8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: d8ed82ef-aec7-43db-9bc8-7f925f7e75cb] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:55.105695 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1617cb62-d41c-4260-85fe-8166d03a85f8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:55.106797 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1617cb62-d41c-4260-85fe-8166d03a85f8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:55.109126 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1617cb62-d41c-4260-85fe-8166d03a85f8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:55.110472 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1617cb62-d41c-4260-85fe-8166d03a85f8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:55.115398 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-70550a49-6626-4138-8371-3504ec608f03 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.280752 May 17 17:28:55.122901 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 355/764] 10.222.0.88 () {60 vars in 1158 bytes} [Tue May 17 17:28:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:28:55.251630 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-f9211b1c-f747-4d97-8d9e-511a46e9e4b6 req-aa4ec96a-88d5-44bf-aa3f-4513d1a5d68e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8ed82ef-aec7-43db-9bc8-7f925f7e75cb", "name": "network-vif-deleted", "tag": "8245b756-0439-403f-a461-14dec64e2814"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:28:55.261781 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-f9211b1c-f747-4d97-8d9e-511a46e9e4b6 req-aa4ec96a-88d5-44bf-aa3f-4513d1a5d68e service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:55.263043 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-f9211b1c-f747-4d97-8d9e-511a46e9e4b6 req-aa4ec96a-88d5-44bf-aa3f-4513d1a5d68e service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:55.267326 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1617cb62-d41c-4260-85fe-8166d03a85f8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:55.278711 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1617cb62-d41c-4260-85fe-8166d03a85f8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb" status: 200 len: 1509 microversion: 2.1 time: 0.190125 May 17 17:28:55.279464 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 410/765] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:28:55 2022] GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb => generated 1509 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:28:55.285204 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-f9211b1c-f747-4d97-8d9e-511a46e9e4b6 req-aa4ec96a-88d5-44bf-aa3f-4513d1a5d68e service nova] Creating event network-vif-deleted:8245b756-0439-403f-a461-14dec64e2814 for instance d8ed82ef-aec7-43db-9bc8-7f925f7e75cb on hv-cinder-84214 May 17 17:28:55.292093 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-f9211b1c-f747-4d97-8d9e-511a46e9e4b6 req-aa4ec96a-88d5-44bf-aa3f-4513d1a5d68e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167438 May 17 17:28:55.292699 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 356/766] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:28:56.299909 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-020ece71-d6a9-48c1-957c-3d4c43027f7d tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:56.300608 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-020ece71-d6a9-48c1-957c-3d4c43027f7d tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: d8ed82ef-aec7-43db-9bc8-7f925f7e75cb] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:56.307031 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-020ece71-d6a9-48c1-957c-3d4c43027f7d tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:56.307484 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-020ece71-d6a9-48c1-957c-3d4c43027f7d tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:56.308523 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-020ece71-d6a9-48c1-957c-3d4c43027f7d tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:56.308993 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-020ece71-d6a9-48c1-957c-3d4c43027f7d tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:56.342648 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-020ece71-d6a9-48c1-957c-3d4c43027f7d tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:56.343102 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-020ece71-d6a9-48c1-957c-3d4c43027f7d tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:56.343583 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-020ece71-d6a9-48c1-957c-3d4c43027f7d tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lazy-loading 'fault' on Instance uuid d8ed82ef-aec7-43db-9bc8-7f925f7e75cb {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:28:56.391558 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-020ece71-d6a9-48c1-957c-3d4c43027f7d tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:56.403464 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-020ece71-d6a9-48c1-957c-3d4c43027f7d tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb" status: 200 len: 1184 microversion: 2.1 time: 0.110183 May 17 17:28:56.404463 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 411/767] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:28:56 2022] GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb => generated 1184 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:28:57.422705 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-eebbdd18-1ed6-4558-9533-e5a65d791f0b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:57.423956 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-eebbdd18-1ed6-4558-9533-e5a65d791f0b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: d8ed82ef-aec7-43db-9bc8-7f925f7e75cb] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:57.430461 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-eebbdd18-1ed6-4558-9533-e5a65d791f0b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:57.430907 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-eebbdd18-1ed6-4558-9533-e5a65d791f0b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:57.431703 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-eebbdd18-1ed6-4558-9533-e5a65d791f0b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:57.432306 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-eebbdd18-1ed6-4558-9533-e5a65d791f0b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:57.449622 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-eebbdd18-1ed6-4558-9533-e5a65d791f0b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] HTTP exception thrown: Instance d8ed82ef-aec7-43db-9bc8-7f925f7e75cb could not be found. May 17 17:28:57.452106 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-eebbdd18-1ed6-4558-9533-e5a65d791f0b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Request method failure captured: May 17 17:28:57.452106 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb HTTP/1.1 May 17 17:28:57.452106 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:28:57.452106 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:28:57.452106 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:28:57.452106 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:28:57.452106 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:28:57.452106 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:28:57.452106 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:28:57.452106 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:28:57.452106 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9qi4Cvf0w5I4IwI8F5CML-0fzsCiCgTNNpg2cCRckAlZ6h09T33QlPj5xsec8xRGNsNuTAvdLDXwhN3kuMdlBDShah_4rbXsVK6k7QPKrvoQBkFuVgJIlWLd2h9KBC9RWh0kS4BvZUHUchdxJpDpWbFjkE0QqODMrsQjpx0LWdDtqQ May 17 17:28:57.452106 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:28:57.452106 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:28:57.452106 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:28:57.452106 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:28:57.452106 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:28:57.452106 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:28:57.452106 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: 3f5eec12182649ba98446cf774faf873 May 17 17:28:57.452106 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-TestVolumeBootPattern-1672536885 May 17 17:28:57.452106 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:28:57.452106 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:28:57.454260 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3f5eec12182649ba98446cf774faf873"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3f5eec12182649ba98446cf774faf873"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3f5eec12182649ba98446cf774faf873"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3f5eec12182649ba98446cf774faf873", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:28:57.454260 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-TestVolumeBootPattern-1672536885 May 17 17:28:57.454260 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: 3f5eec12182649ba98446cf774faf873 May 17 17:28:57.454260 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-TestVolumeBootPattern-1672536885 May 17 17:28:57.454260 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-TestVolumeBootPattern-1672536885-project May 17 17:28:57.454260 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:28:57.454260 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:28:57.454260 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 6cbe2975d6d24b4280a28056afaeb873 May 17 17:28:57.454260 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-TestVolumeBootPattern-1672536885-project May 17 17:28:57.454260 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:28:57.454260 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Instance d8ed82ef-aec7-43db-9bc8-7f925f7e75cb could not be found. May 17 17:28:57.454260 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': 'd8ed82ef-aec7-43db-9bc8-7f925f7e75cb'} May 17 17:28:57.455203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:28:57.455203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:28:57.455203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:28:57.455203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:28:57.455203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:28:57.455203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:28:57.455203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:28:57.455203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:28:57.455203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:28:57.455203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:28:57.455203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8ed82ef-aec7-43db-9bc8-7f925f7e75cb could not be found. May 17 17:28:57.455203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:28:57.455203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:28:57.455203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:28:57.455203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:28:57.455203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:28:57.455203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:28:57.455203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:28:57.455203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:28:57.455203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:28:57.457513 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:28:57.457513 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:28:57.457513 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:28:57.457513 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:28:57.457513 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:28:57.457513 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:28:57.457513 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:28:57.457513 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8ed82ef-aec7-43db-9bc8-7f925f7e75cb could not be found. May 17 17:28:57.457513 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:28:57.457513 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:28:57.457513 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:28:57.457513 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:28:57.457513 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:28:57.457513 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:28:57.457513 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:28:57.457513 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:28:57.457513 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8ed82ef-aec7-43db-9bc8-7f925f7e75cb could not be found. May 17 17:28:57.457513 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:28:57.466588 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-eebbdd18-1ed6-4558-9533-e5a65d791f0b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Returning 404 to user: Instance d8ed82ef-aec7-43db-9bc8-7f925f7e75cb could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:28:57.467940 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-eebbdd18-1ed6-4558-9533-e5a65d791f0b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb" status: 404 len: 111 microversion: 2.1 time: 0.049036 May 17 17:28:57.469374 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 357/768] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:28:57 2022] GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:28:57.671105 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c42f06b2-315b-44f3-ac77-da621398b5c6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1098812377", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-647335372", "security_groups": [{"name": "tempest-secgroup-smoke-42262070"}], "block_device_mapping_v2": [{"uuid": "62f07cd5-2a21-48cd-bafa-6dd65b8d819a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fcf7be69-9ae2-4258-af0f-0fdac2597600"}]}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:28:57.820147 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.network.neutron [None req-c42f06b2-315b-44f3-ac77-da621398b5c6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] validate_networks() for [('fcf7be69-9ae2-4258-af0f-0fdac2597600', None, None, None, None, None)] {{(pid=117612) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:28:57.918257 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-9a6e3922-8a4e-460e-9761-e21e2484d250 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-373143881", "imageRef": "800c492c-ff69-4735-b2c9-a2dcaa20aa8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ace36e5-8f62-484d-869a-4e76e67d3437"}], "security_groups": [{"name": "tempest-securitygroup--1352810331"}], "key_name": "tempest-keypair-948066528", "user_data": "}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:28:58.090354 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.network.neutron [None req-9a6e3922-8a4e-460e-9761-e21e2484d250 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] validate_networks() for [('1ace36e5-8f62-484d-869a-4e76e67d3437', None, None, None, None, None)] {{(pid=117611) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:28:58.545313 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-c42f06b2-315b-44f3-ac77-da621398b5c6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Flavor limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:28:58.546014 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-c42f06b2-315b-44f3-ac77-da621398b5c6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Image limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:28:58.546699 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-c42f06b2-315b-44f3-ac77-da621398b5c6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Flavor pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:28:58.547401 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-c42f06b2-315b-44f3-ac77-da621398b5c6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Image pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:28:58.547908 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-c42f06b2-315b-44f3-ac77-da621398b5c6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:28:58.557727 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c42f06b2-315b-44f3-ac77-da621398b5c6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:58.558658 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c42f06b2-315b-44f3-ac77-da621398b5c6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:58.559737 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c42f06b2-315b-44f3-ac77-da621398b5c6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:58.560399 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c42f06b2-315b-44f3-ac77-da621398b5c6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:58.579593 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-c42f06b2-315b-44f3-ac77-da621398b5c6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Getting quotas for project 3f5eec12182649ba98446cf774faf873. Resources: {'cores', 'ram', 'instances'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:28:58.583842 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-c42f06b2-315b-44f3-ac77-da621398b5c6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Getting quotas for user 6cbe2975d6d24b4280a28056afaeb873 and project 3f5eec12182649ba98446cf774faf873. Resources: {'cores', 'ram', 'instances'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:28:58.641653 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-9a6e3922-8a4e-460e-9761-e21e2484d250 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Flavor limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:28:58.642130 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-9a6e3922-8a4e-460e-9761-e21e2484d250 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Image limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:28:58.642557 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-9a6e3922-8a4e-460e-9761-e21e2484d250 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Flavor pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:28:58.642958 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-9a6e3922-8a4e-460e-9761-e21e2484d250 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Image pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:28:58.643370 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-9a6e3922-8a4e-460e-9761-e21e2484d250 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:28:58.653228 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9a6e3922-8a4e-460e-9761-e21e2484d250 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:58.653687 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9a6e3922-8a4e-460e-9761-e21e2484d250 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:58.654831 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9a6e3922-8a4e-460e-9761-e21e2484d250 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:28:58.655994 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c42f06b2-315b-44f3-ac77-da621398b5c6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Going to run 1 instances... {{(pid=117612) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:28:58.656155 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9a6e3922-8a4e-460e-9761-e21e2484d250 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:28:58.658168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c42f06b2-315b-44f3-ac77-da621398b5c6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 29c1b694-47cb-44ac-951e-6db2dc2437da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='62f07cd5-2a21-48cd-bafa-6dd65b8d819a',volume_size=None,volume_type=None)] {{(pid=117612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:28:58.675533 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-9a6e3922-8a4e-460e-9761-e21e2484d250 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Getting quotas for project ed4b8b6a551347b6a920e4cfb59b9480. Resources: {'cores', 'ram', 'instances'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:28:58.680537 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-9a6e3922-8a4e-460e-9761-e21e2484d250 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Getting quotas for user 7b22bf1b41774f64b7a380d86ef3f72e and project ed4b8b6a551347b6a920e4cfb59b9480. Resources: {'cores', 'ram', 'instances'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:28:58.694337 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-9a6e3922-8a4e-460e-9761-e21e2484d250 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Going to run 1 instances... {{(pid=117611) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:28:58.696656 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-9a6e3922-8a4e-460e-9761-e21e2484d250 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='800c492c-ff69-4735-b2c9-a2dcaa20aa8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:28:58.837897 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-9a6e3922-8a4e-460e-9761-e21e2484d250 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.923839 May 17 17:28:58.838541 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 358/769] 10.222.0.88 () {60 vars in 1146 bytes} [Tue May 17 17:28:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 17 17:28:58.849586 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-43ebe457-d1f9-4d44-a02d-c04ffdaebb4d tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:58.850431 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-43ebe457-d1f9-4d44-a02d-c04ffdaebb4d tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:58.909056 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-43ebe457-d1f9-4d44-a02d-c04ffdaebb4d tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:58.917605 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-43ebe457-d1f9-4d44-a02d-c04ffdaebb4d tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690" status: 200 len: 1240 microversion: 2.1 time: 0.071976 May 17 17:28:58.918418 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 359/770] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:28:58 2022] GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690 => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:28:59.126124 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c42f06b2-315b-44f3-ac77-da621398b5c6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.458909 May 17 17:28:59.127006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 412/771] 10.222.0.88 () {60 vars in 1146 bytes} [Tue May 17 17:28:57 2022] POST /compute/v2.1/servers => generated 404 bytes in 1460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:28:59.137223 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3c2858e8-7ab7-4d6c-86c2-cb9af5281719 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:59.137926 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3c2858e8-7ab7-4d6c-86c2-cb9af5281719 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 29c1b694-47cb-44ac-951e-6db2dc2437da] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:59.193593 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3c2858e8-7ab7-4d6c-86c2-cb9af5281719 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:59.200481 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3c2858e8-7ab7-4d6c-86c2-cb9af5281719 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da" status: 200 len: 1094 microversion: 2.1 time: 0.067073 May 17 17:28:59.201356 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 360/772] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:28:59 2022] GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:28:59.934564 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-41847a93-62a1-4cd9-bec6-1b016e637d46 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:28:59.935179 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-41847a93-62a1-4cd9-bec6-1b016e637d46 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:28:59.986404 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-41847a93-62a1-4cd9-bec6-1b016e637d46 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:28:59.992943 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-41847a93-62a1-4cd9-bec6-1b016e637d46 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690" status: 200 len: 1240 microversion: 2.1 time: 0.062376 May 17 17:28:59.993505 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 413/773] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:28:59 2022] GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690 => generated 1240 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:00.219035 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-610541f6-90f8-4273-ade0-adcb157dbcbc tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:00.219671 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-610541f6-90f8-4273-ade0-adcb157dbcbc tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 29c1b694-47cb-44ac-951e-6db2dc2437da] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:00.226515 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-610541f6-90f8-4273-ade0-adcb157dbcbc tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:00.226996 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-610541f6-90f8-4273-ade0-adcb157dbcbc tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:00.227799 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-610541f6-90f8-4273-ade0-adcb157dbcbc tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:00.228249 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-610541f6-90f8-4273-ade0-adcb157dbcbc tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:00.288045 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-610541f6-90f8-4273-ade0-adcb157dbcbc tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:00.295194 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-610541f6-90f8-4273-ade0-adcb157dbcbc tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da" status: 200 len: 1144 microversion: 2.1 time: 0.080223 May 17 17:29:00.295789 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 361/774] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:00 2022] GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da => generated 1144 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:01.009830 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-873308ab-c53e-4b27-a61d-6e4d328219cc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:01.010387 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-873308ab-c53e-4b27-a61d-6e4d328219cc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:01.017598 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-873308ab-c53e-4b27-a61d-6e4d328219cc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:01.018049 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-873308ab-c53e-4b27-a61d-6e4d328219cc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:01.018908 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-873308ab-c53e-4b27-a61d-6e4d328219cc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:01.019340 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-873308ab-c53e-4b27-a61d-6e4d328219cc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:01.085388 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-873308ab-c53e-4b27-a61d-6e4d328219cc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:01.092555 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-873308ab-c53e-4b27-a61d-6e4d328219cc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690" status: 200 len: 1292 microversion: 2.1 time: 0.086701 May 17 17:29:01.093116 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 414/775] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:01 2022] GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690 => generated 1292 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:01.313598 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-271b4a47-5b89-44dc-8ca1-5af9ea34ca33 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:01.314812 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-271b4a47-5b89-44dc-8ca1-5af9ea34ca33 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 29c1b694-47cb-44ac-951e-6db2dc2437da] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:01.325084 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-271b4a47-5b89-44dc-8ca1-5af9ea34ca33 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:01.325555 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-271b4a47-5b89-44dc-8ca1-5af9ea34ca33 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:01.326325 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-271b4a47-5b89-44dc-8ca1-5af9ea34ca33 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:01.326759 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-271b4a47-5b89-44dc-8ca1-5af9ea34ca33 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:01.393696 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-271b4a47-5b89-44dc-8ca1-5af9ea34ca33 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:01.400946 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-271b4a47-5b89-44dc-8ca1-5af9ea34ca33 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da" status: 200 len: 1200 microversion: 2.1 time: 0.092071 May 17 17:29:01.401510 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 362/776] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:01 2022] GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da => generated 1200 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:02.123481 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-08870b6d-0b04-4b06-85cc-33cfeb0ce365 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:02.123481 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-08870b6d-0b04-4b06-85cc-33cfeb0ce365 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:02.140146 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-08870b6d-0b04-4b06-85cc-33cfeb0ce365 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:02.144873 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-08870b6d-0b04-4b06-85cc-33cfeb0ce365 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:02.146056 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-08870b6d-0b04-4b06-85cc-33cfeb0ce365 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:02.146543 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-08870b6d-0b04-4b06-85cc-33cfeb0ce365 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:02.221976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-08870b6d-0b04-4b06-85cc-33cfeb0ce365 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:02.229990 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-08870b6d-0b04-4b06-85cc-33cfeb0ce365 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690" status: 200 len: 1298 microversion: 2.1 time: 0.123896 May 17 17:29:02.230623 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 415/777] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:02 2022] GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690 => generated 1298 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:02.421307 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f7fed12c-ce20-47a1-b15e-7cfe0426ec43 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:02.422551 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f7fed12c-ce20-47a1-b15e-7cfe0426ec43 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 29c1b694-47cb-44ac-951e-6db2dc2437da] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:02.430036 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f7fed12c-ce20-47a1-b15e-7cfe0426ec43 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:02.430476 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f7fed12c-ce20-47a1-b15e-7cfe0426ec43 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:02.431256 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f7fed12c-ce20-47a1-b15e-7cfe0426ec43 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:02.431903 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f7fed12c-ce20-47a1-b15e-7cfe0426ec43 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:02.623076 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f7fed12c-ce20-47a1-b15e-7cfe0426ec43 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:02.631233 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f7fed12c-ce20-47a1-b15e-7cfe0426ec43 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da" status: 200 len: 1276 microversion: 2.1 time: 0.213713 May 17 17:29:02.631866 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 363/778] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:02 2022] GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da => generated 1276 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:03.247856 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0ab90ad2-849c-4a32-a742-b0c7a3a380e8 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:03.248567 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0ab90ad2-849c-4a32-a742-b0c7a3a380e8 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:03.255036 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0ab90ad2-849c-4a32-a742-b0c7a3a380e8 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:03.255859 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0ab90ad2-849c-4a32-a742-b0c7a3a380e8 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:03.256940 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0ab90ad2-849c-4a32-a742-b0c7a3a380e8 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:03.257607 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0ab90ad2-849c-4a32-a742-b0c7a3a380e8 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:03.376950 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-49bc17bc-2e90-4b13-9e36-d600789b8a44 req-dde2a820-8ddc-4bdb-9ccf-b45b48dbd6fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29c1b694-47cb-44ac-951e-6db2dc2437da", "tag": "2b97f078-d722-4799-b3c2-7303b516b2a3"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:29:03.393706 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-49bc17bc-2e90-4b13-9e36-d600789b8a44 req-dde2a820-8ddc-4bdb-9ccf-b45b48dbd6fd service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:03.399360 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-49bc17bc-2e90-4b13-9e36-d600789b8a44 req-dde2a820-8ddc-4bdb-9ccf-b45b48dbd6fd service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:03.421188 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-49bc17bc-2e90-4b13-9e36-d600789b8a44 req-dde2a820-8ddc-4bdb-9ccf-b45b48dbd6fd service nova] Creating event network-changed:2b97f078-d722-4799-b3c2-7303b516b2a3 for instance 29c1b694-47cb-44ac-951e-6db2dc2437da on hv-cinder-84214 May 17 17:29:03.431784 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-49bc17bc-2e90-4b13-9e36-d600789b8a44 req-dde2a820-8ddc-4bdb-9ccf-b45b48dbd6fd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058827 May 17 17:29:03.435330 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 364/779] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:29:03.474592 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0ab90ad2-849c-4a32-a742-b0c7a3a380e8 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:03.483538 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0ab90ad2-849c-4a32-a742-b0c7a3a380e8 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690" status: 200 len: 1366 microversion: 2.1 time: 0.239494 May 17 17:29:03.484910 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 416/780] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:03 2022] GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:03.649719 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-49bd9907-2ad1-4483-b1f8-c1d5e100db60 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:03.653431 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-49bd9907-2ad1-4483-b1f8-c1d5e100db60 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 29c1b694-47cb-44ac-951e-6db2dc2437da] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:03.657124 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-49bd9907-2ad1-4483-b1f8-c1d5e100db60 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:03.657736 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-49bd9907-2ad1-4483-b1f8-c1d5e100db60 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:03.658568 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-49bd9907-2ad1-4483-b1f8-c1d5e100db60 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:03.659081 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-49bd9907-2ad1-4483-b1f8-c1d5e100db60 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:04.056975 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-49bd9907-2ad1-4483-b1f8-c1d5e100db60 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:04.067291 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-49bd9907-2ad1-4483-b1f8-c1d5e100db60 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da" status: 200 len: 1264 microversion: 2.1 time: 0.422115 May 17 17:29:04.068493 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 365/781] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:03 2022] GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da => generated 1264 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:04.244908 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-4573b76b-0dc9-49e4-a420-8fb743054c82 req-7c0b0772-6d1d-4a00-a196-7cb8f7d29b57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ace49a2e-2ed3-43e0-a7c4-e275251ff690", "tag": "2a8d5fdf-e913-47e8-a4f2-a122eca6ae7c"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:29:04.259604 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-4573b76b-0dc9-49e4-a420-8fb743054c82 req-7c0b0772-6d1d-4a00-a196-7cb8f7d29b57 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:04.260734 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-4573b76b-0dc9-49e4-a420-8fb743054c82 req-7c0b0772-6d1d-4a00-a196-7cb8f7d29b57 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:04.273634 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-4573b76b-0dc9-49e4-a420-8fb743054c82 req-7c0b0772-6d1d-4a00-a196-7cb8f7d29b57 service nova] Creating event network-changed:2a8d5fdf-e913-47e8-a4f2-a122eca6ae7c for instance ace49a2e-2ed3-43e0-a7c4-e275251ff690 on hv-cinder-84214 May 17 17:29:04.279903 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-4573b76b-0dc9-49e4-a420-8fb743054c82 req-7c0b0772-6d1d-4a00-a196-7cb8f7d29b57 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038095 May 17 17:29:04.280597 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 417/782] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:29:04.501626 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-45723604-0c5b-4619-8fff-9d3b50f1e8da tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:04.502354 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-45723604-0c5b-4619-8fff-9d3b50f1e8da tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:04.509761 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-45723604-0c5b-4619-8fff-9d3b50f1e8da tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:04.510249 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-45723604-0c5b-4619-8fff-9d3b50f1e8da tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:04.511148 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-45723604-0c5b-4619-8fff-9d3b50f1e8da tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:04.511685 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-45723604-0c5b-4619-8fff-9d3b50f1e8da tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:04.647183 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-45723604-0c5b-4619-8fff-9d3b50f1e8da tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:04.654712 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-45723604-0c5b-4619-8fff-9d3b50f1e8da tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690" status: 200 len: 1366 microversion: 2.1 time: 0.157500 May 17 17:29:04.655296 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 366/783] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:04 2022] GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:05.084809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5b5c1715-db82-4196-a494-c5ab2cce867f tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:05.085508 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5b5c1715-db82-4196-a494-c5ab2cce867f tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 29c1b694-47cb-44ac-951e-6db2dc2437da] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:05.091457 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5b5c1715-db82-4196-a494-c5ab2cce867f tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:05.091940 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5b5c1715-db82-4196-a494-c5ab2cce867f tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:05.092705 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5b5c1715-db82-4196-a494-c5ab2cce867f tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:05.093140 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5b5c1715-db82-4196-a494-c5ab2cce867f tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:05.220744 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5b5c1715-db82-4196-a494-c5ab2cce867f tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:05.228040 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5b5c1715-db82-4196-a494-c5ab2cce867f tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da" status: 200 len: 1264 microversion: 2.1 time: 0.147387 May 17 17:29:05.231836 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 418/784] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:05 2022] GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:05.677178 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-395f8be9-10c9-4484-9844-701b5ae5b242 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:05.677796 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-395f8be9-10c9-4484-9844-701b5ae5b242 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:05.684246 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-395f8be9-10c9-4484-9844-701b5ae5b242 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:05.684701 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-395f8be9-10c9-4484-9844-701b5ae5b242 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:05.685478 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-395f8be9-10c9-4484-9844-701b5ae5b242 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:05.685912 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-395f8be9-10c9-4484-9844-701b5ae5b242 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:05.810022 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-395f8be9-10c9-4484-9844-701b5ae5b242 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:05.817642 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-395f8be9-10c9-4484-9844-701b5ae5b242 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690" status: 200 len: 1366 microversion: 2.1 time: 0.144420 May 17 17:29:05.818199 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 367/785] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:05 2022] GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:29:06.246020 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-abbe865a-e5b1-431a-99ab-4ac37d1fcfd9 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:06.246621 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-abbe865a-e5b1-431a-99ab-4ac37d1fcfd9 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 29c1b694-47cb-44ac-951e-6db2dc2437da] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:06.253526 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-abbe865a-e5b1-431a-99ab-4ac37d1fcfd9 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:06.253974 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-abbe865a-e5b1-431a-99ab-4ac37d1fcfd9 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:06.254738 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-abbe865a-e5b1-431a-99ab-4ac37d1fcfd9 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:06.255169 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-abbe865a-e5b1-431a-99ab-4ac37d1fcfd9 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:06.383662 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-abbe865a-e5b1-431a-99ab-4ac37d1fcfd9 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:06.390794 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-abbe865a-e5b1-431a-99ab-4ac37d1fcfd9 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da" status: 200 len: 1264 microversion: 2.1 time: 0.148573 May 17 17:29:06.391342 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 419/786] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:06 2022] GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:06.834074 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b9a0b55f-f595-415c-aa50-a7757ae106a1 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:06.834683 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b9a0b55f-f595-415c-aa50-a7757ae106a1 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:06.840857 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b9a0b55f-f595-415c-aa50-a7757ae106a1 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:06.841303 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b9a0b55f-f595-415c-aa50-a7757ae106a1 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:06.842069 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b9a0b55f-f595-415c-aa50-a7757ae106a1 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:06.842507 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b9a0b55f-f595-415c-aa50-a7757ae106a1 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:06.969963 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b9a0b55f-f595-415c-aa50-a7757ae106a1 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:06.977425 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b9a0b55f-f595-415c-aa50-a7757ae106a1 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690" status: 200 len: 1366 microversion: 2.1 time: 0.147018 May 17 17:29:06.977924 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 368/787] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:06 2022] GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:07.408309 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-bdf06d2c-4ed3-4e0d-8f79-2173bc8e9bf6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:07.409027 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-bdf06d2c-4ed3-4e0d-8f79-2173bc8e9bf6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 29c1b694-47cb-44ac-951e-6db2dc2437da] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:07.415765 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bdf06d2c-4ed3-4e0d-8f79-2173bc8e9bf6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:07.416216 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bdf06d2c-4ed3-4e0d-8f79-2173bc8e9bf6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:07.416995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bdf06d2c-4ed3-4e0d-8f79-2173bc8e9bf6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:07.417443 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bdf06d2c-4ed3-4e0d-8f79-2173bc8e9bf6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:07.583584 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-bdf06d2c-4ed3-4e0d-8f79-2173bc8e9bf6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:07.590980 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-bdf06d2c-4ed3-4e0d-8f79-2173bc8e9bf6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da" status: 200 len: 1264 microversion: 2.1 time: 0.187176 May 17 17:29:07.591643 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 420/788] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:07 2022] GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:07.993622 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4c7b08bb-9850-4711-8f51-7e8f84393d77 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:07.994224 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4c7b08bb-9850-4711-8f51-7e8f84393d77 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:08.001960 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4c7b08bb-9850-4711-8f51-7e8f84393d77 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:08.002426 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4c7b08bb-9850-4711-8f51-7e8f84393d77 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:08.003395 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4c7b08bb-9850-4711-8f51-7e8f84393d77 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:08.003861 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4c7b08bb-9850-4711-8f51-7e8f84393d77 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:08.135042 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4c7b08bb-9850-4711-8f51-7e8f84393d77 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:08.143183 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4c7b08bb-9850-4711-8f51-7e8f84393d77 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690" status: 200 len: 1366 microversion: 2.1 time: 0.153401 May 17 17:29:08.144068 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 369/789] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:07 2022] GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:08.608581 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b311f46b-009f-4eb7-bbad-75d6c6092fd6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:08.609624 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b311f46b-009f-4eb7-bbad-75d6c6092fd6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 29c1b694-47cb-44ac-951e-6db2dc2437da] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:08.615972 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b311f46b-009f-4eb7-bbad-75d6c6092fd6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:08.616424 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b311f46b-009f-4eb7-bbad-75d6c6092fd6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:08.617194 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b311f46b-009f-4eb7-bbad-75d6c6092fd6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:08.617633 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b311f46b-009f-4eb7-bbad-75d6c6092fd6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:08.774613 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b311f46b-009f-4eb7-bbad-75d6c6092fd6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:08.782328 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b311f46b-009f-4eb7-bbad-75d6c6092fd6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da" status: 200 len: 1264 microversion: 2.1 time: 0.177698 May 17 17:29:08.782894 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 421/790] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:08 2022] GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:09.160562 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-967d9df4-06f2-4a2b-9f36-8917de3c03e2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:09.161444 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-967d9df4-06f2-4a2b-9f36-8917de3c03e2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:09.167800 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-967d9df4-06f2-4a2b-9f36-8917de3c03e2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:09.168251 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-967d9df4-06f2-4a2b-9f36-8917de3c03e2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:09.169215 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-967d9df4-06f2-4a2b-9f36-8917de3c03e2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:09.169600 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-967d9df4-06f2-4a2b-9f36-8917de3c03e2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:09.300786 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-967d9df4-06f2-4a2b-9f36-8917de3c03e2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:09.307875 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-967d9df4-06f2-4a2b-9f36-8917de3c03e2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690" status: 200 len: 1366 microversion: 2.1 time: 0.151731 May 17 17:29:09.308468 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 370/791] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:09 2022] GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:09.639109 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-de53f92e-fec3-464c-8f6e-c3e7ac5b65a6 req-a85a3ac9-78a2-4d0e-a849-2073bfaf1a07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ace49a2e-2ed3-43e0-a7c4-e275251ff690", "name": "network-vif-plugged", "status": "completed", "tag": "2a8d5fdf-e913-47e8-a4f2-a122eca6ae7c"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:29:09.646107 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-de53f92e-fec3-464c-8f6e-c3e7ac5b65a6 req-a85a3ac9-78a2-4d0e-a849-2073bfaf1a07 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:09.646107 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-de53f92e-fec3-464c-8f6e-c3e7ac5b65a6 req-a85a3ac9-78a2-4d0e-a849-2073bfaf1a07 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:09.659954 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-de53f92e-fec3-464c-8f6e-c3e7ac5b65a6 req-a85a3ac9-78a2-4d0e-a849-2073bfaf1a07 service nova] Creating event network-vif-plugged:2a8d5fdf-e913-47e8-a4f2-a122eca6ae7c for instance ace49a2e-2ed3-43e0-a7c4-e275251ff690 on hv-cinder-84214 May 17 17:29:09.665454 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-de53f92e-fec3-464c-8f6e-c3e7ac5b65a6 req-a85a3ac9-78a2-4d0e-a849-2073bfaf1a07 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033058 May 17 17:29:09.666035 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 422/792] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:29:09.799866 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7af3def2-0f44-4b47-a2e6-1f75dcb173b0 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:09.800413 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-7af3def2-0f44-4b47-a2e6-1f75dcb173b0 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 29c1b694-47cb-44ac-951e-6db2dc2437da] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:09.806535 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7af3def2-0f44-4b47-a2e6-1f75dcb173b0 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:09.807594 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7af3def2-0f44-4b47-a2e6-1f75dcb173b0 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:09.807756 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7af3def2-0f44-4b47-a2e6-1f75dcb173b0 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:09.808192 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7af3def2-0f44-4b47-a2e6-1f75dcb173b0 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:09.974643 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7af3def2-0f44-4b47-a2e6-1f75dcb173b0 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:09.981891 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-7af3def2-0f44-4b47-a2e6-1f75dcb173b0 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da" status: 200 len: 1264 microversion: 2.1 time: 0.186539 May 17 17:29:09.982446 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 371/793] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:09 2022] GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:10.325341 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-fff44c52-3abb-4bd5-bbdd-572332f00c6d tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:10.326109 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-fff44c52-3abb-4bd5-bbdd-572332f00c6d tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:10.332904 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fff44c52-3abb-4bd5-bbdd-572332f00c6d tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:10.333360 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fff44c52-3abb-4bd5-bbdd-572332f00c6d tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:10.334124 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fff44c52-3abb-4bd5-bbdd-572332f00c6d tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:10.334563 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fff44c52-3abb-4bd5-bbdd-572332f00c6d tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:10.475873 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-fff44c52-3abb-4bd5-bbdd-572332f00c6d tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:10.485124 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-fff44c52-3abb-4bd5-bbdd-572332f00c6d tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690" status: 200 len: 1366 microversion: 2.1 time: 0.163660 May 17 17:29:10.485962 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 423/794] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:10 2022] GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:10.998368 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4161ce52-0f19-439f-a969-767ffad10547 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:10.998906 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4161ce52-0f19-439f-a969-767ffad10547 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 29c1b694-47cb-44ac-951e-6db2dc2437da] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:11.005789 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4161ce52-0f19-439f-a969-767ffad10547 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:11.006240 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4161ce52-0f19-439f-a969-767ffad10547 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:11.007003 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4161ce52-0f19-439f-a969-767ffad10547 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:11.007438 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4161ce52-0f19-439f-a969-767ffad10547 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:11.136602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4161ce52-0f19-439f-a969-767ffad10547 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:11.143742 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4161ce52-0f19-439f-a969-767ffad10547 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da" status: 200 len: 1264 microversion: 2.1 time: 0.149271 May 17 17:29:11.144307 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 372/795] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:10 2022] GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:11.502676 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-436ca860-9444-4d1d-884f-8aa2ff91ac3f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:11.503324 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-436ca860-9444-4d1d-884f-8aa2ff91ac3f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:11.509563 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-436ca860-9444-4d1d-884f-8aa2ff91ac3f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:11.510015 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-436ca860-9444-4d1d-884f-8aa2ff91ac3f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:11.510794 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-436ca860-9444-4d1d-884f-8aa2ff91ac3f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:11.511231 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-436ca860-9444-4d1d-884f-8aa2ff91ac3f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:11.641959 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-436ca860-9444-4d1d-884f-8aa2ff91ac3f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:11.649354 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-436ca860-9444-4d1d-884f-8aa2ff91ac3f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690" status: 200 len: 1366 microversion: 2.1 time: 0.151042 May 17 17:29:11.649922 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 424/796] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:11 2022] GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:12.160233 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f1a6bcb2-b18d-4881-86e3-3d62135ccbff tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:12.160757 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f1a6bcb2-b18d-4881-86e3-3d62135ccbff tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 29c1b694-47cb-44ac-951e-6db2dc2437da] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:12.167238 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f1a6bcb2-b18d-4881-86e3-3d62135ccbff tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:12.167730 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f1a6bcb2-b18d-4881-86e3-3d62135ccbff tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:12.168486 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f1a6bcb2-b18d-4881-86e3-3d62135ccbff tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:12.168913 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f1a6bcb2-b18d-4881-86e3-3d62135ccbff tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:12.297814 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f1a6bcb2-b18d-4881-86e3-3d62135ccbff tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:12.304942 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f1a6bcb2-b18d-4881-86e3-3d62135ccbff tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da" status: 200 len: 1264 microversion: 2.1 time: 0.148696 May 17 17:29:12.305512 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 373/797] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:12 2022] GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:12.666281 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-701cec5b-b260-4a23-b9f8-70641937765e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:12.666889 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-701cec5b-b260-4a23-b9f8-70641937765e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:12.673383 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-701cec5b-b260-4a23-b9f8-70641937765e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:12.673836 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-701cec5b-b260-4a23-b9f8-70641937765e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:12.674612 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-701cec5b-b260-4a23-b9f8-70641937765e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:12.675084 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-701cec5b-b260-4a23-b9f8-70641937765e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:12.803016 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-701cec5b-b260-4a23-b9f8-70641937765e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:12.811718 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-701cec5b-b260-4a23-b9f8-70641937765e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690" status: 200 len: 1557 microversion: 2.1 time: 0.149156 May 17 17:29:12.813154 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 425/798] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:12 2022] GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:12.828631 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b8c0f700-cc1d-42f5-9cdb-2df0a6af0292 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:12.829122 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b8c0f700-cc1d-42f5-9cdb-2df0a6af0292 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:12.834982 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b8c0f700-cc1d-42f5-9cdb-2df0a6af0292 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:12.835425 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b8c0f700-cc1d-42f5-9cdb-2df0a6af0292 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:12.836218 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b8c0f700-cc1d-42f5-9cdb-2df0a6af0292 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:12.836647 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b8c0f700-cc1d-42f5-9cdb-2df0a6af0292 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:12.911008 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b8c0f700-cc1d-42f5-9cdb-2df0a6af0292 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.086220 May 17 17:29:12.911911 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 374/799] 10.222.0.88 () {58 vars in 1274 bytes} [Tue May 17 17:29:12 2022] GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:29:13.322111 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2ebdf415-fd19-4065-b91b-3adf02f93319 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:13.322777 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2ebdf415-fd19-4065-b91b-3adf02f93319 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 29c1b694-47cb-44ac-951e-6db2dc2437da] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:13.329290 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2ebdf415-fd19-4065-b91b-3adf02f93319 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:13.329736 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2ebdf415-fd19-4065-b91b-3adf02f93319 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:13.330502 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2ebdf415-fd19-4065-b91b-3adf02f93319 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:13.331005 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2ebdf415-fd19-4065-b91b-3adf02f93319 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:13.473735 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2ebdf415-fd19-4065-b91b-3adf02f93319 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:13.481414 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2ebdf415-fd19-4065-b91b-3adf02f93319 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da" status: 200 len: 1264 microversion: 2.1 time: 0.163156 May 17 17:29:13.490476 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 426/800] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:13 2022] GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:13.646754 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-1e00935d-1580-478e-8ef0-d93444d35367 req-6aeefd47-57e4-42b1-97a0-691b6f4563d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29c1b694-47cb-44ac-951e-6db2dc2437da", "name": "network-vif-plugged", "status": "completed", "tag": "2b97f078-d722-4799-b3c2-7303b516b2a3"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:29:13.655140 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-1e00935d-1580-478e-8ef0-d93444d35367 req-6aeefd47-57e4-42b1-97a0-691b6f4563d7 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:13.655710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-1e00935d-1580-478e-8ef0-d93444d35367 req-6aeefd47-57e4-42b1-97a0-691b6f4563d7 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:13.668169 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-1e00935d-1580-478e-8ef0-d93444d35367 req-6aeefd47-57e4-42b1-97a0-691b6f4563d7 service nova] Creating event network-vif-plugged:2b97f078-d722-4799-b3c2-7303b516b2a3 for instance 29c1b694-47cb-44ac-951e-6db2dc2437da on hv-cinder-84214 May 17 17:29:13.673684 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-1e00935d-1580-478e-8ef0-d93444d35367 req-6aeefd47-57e4-42b1-97a0-691b6f4563d7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031201 May 17 17:29:13.674519 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 375/801] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:29:13.919150 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-d52ba36b-f567-490e-9327-95bf69c30de6 req-dace8284-9834-4e4f-b6bb-1b53e19d6414 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ace49a2e-2ed3-43e0-a7c4-e275251ff690", "tag": "2a8d5fdf-e913-47e8-a4f2-a122eca6ae7c"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:29:13.928135 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-d52ba36b-f567-490e-9327-95bf69c30de6 req-dace8284-9834-4e4f-b6bb-1b53e19d6414 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:13.928678 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-d52ba36b-f567-490e-9327-95bf69c30de6 req-dace8284-9834-4e4f-b6bb-1b53e19d6414 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:13.940398 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-d52ba36b-f567-490e-9327-95bf69c30de6 req-dace8284-9834-4e4f-b6bb-1b53e19d6414 service nova] Creating event network-changed:2a8d5fdf-e913-47e8-a4f2-a122eca6ae7c for instance ace49a2e-2ed3-43e0-a7c4-e275251ff690 on hv-cinder-84214 May 17 17:29:13.945578 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-d52ba36b-f567-490e-9327-95bf69c30de6 req-dace8284-9834-4e4f-b6bb-1b53e19d6414 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030135 May 17 17:29:13.946436 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 427/802] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:29:14.498654 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a79771e6-c81d-4895-8cb8-cd006bc71f19 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:14.500176 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a79771e6-c81d-4895-8cb8-cd006bc71f19 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 29c1b694-47cb-44ac-951e-6db2dc2437da] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:14.506760 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a79771e6-c81d-4895-8cb8-cd006bc71f19 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:14.506956 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a79771e6-c81d-4895-8cb8-cd006bc71f19 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:14.507755 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a79771e6-c81d-4895-8cb8-cd006bc71f19 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:14.508190 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a79771e6-c81d-4895-8cb8-cd006bc71f19 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:14.648593 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a79771e6-c81d-4895-8cb8-cd006bc71f19 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:14.656177 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a79771e6-c81d-4895-8cb8-cd006bc71f19 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da" status: 200 len: 1264 microversion: 2.1 time: 0.161799 May 17 17:29:14.656842 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 376/803] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:14 2022] GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:15.676614 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1a1d986c-809c-4e58-a512-2efa504e8db8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:15.677379 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1a1d986c-809c-4e58-a512-2efa504e8db8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 29c1b694-47cb-44ac-951e-6db2dc2437da] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:15.684061 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1a1d986c-809c-4e58-a512-2efa504e8db8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:15.684449 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1a1d986c-809c-4e58-a512-2efa504e8db8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:15.685229 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1a1d986c-809c-4e58-a512-2efa504e8db8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:15.685796 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1a1d986c-809c-4e58-a512-2efa504e8db8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:15.819649 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1a1d986c-809c-4e58-a512-2efa504e8db8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:15.826893 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1a1d986c-809c-4e58-a512-2efa504e8db8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da" status: 200 len: 1452 microversion: 2.1 time: 0.156941 May 17 17:29:15.827459 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 428/804] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:15 2022] GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:15.842632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-36003964-581d-4b7d-bb3c-5136259093c7 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:15.847027 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-36003964-581d-4b7d-bb3c-5136259093c7 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 29c1b694-47cb-44ac-951e-6db2dc2437da] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:15.850110 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-36003964-581d-4b7d-bb3c-5136259093c7 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:15.850555 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-36003964-581d-4b7d-bb3c-5136259093c7 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:15.851321 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-36003964-581d-4b7d-bb3c-5136259093c7 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:15.851791 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-36003964-581d-4b7d-bb3c-5136259093c7 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:15.984281 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-36003964-581d-4b7d-bb3c-5136259093c7 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:15.991985 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-36003964-581d-4b7d-bb3c-5136259093c7 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da" status: 200 len: 1452 microversion: 2.1 time: 0.153077 May 17 17:29:15.992548 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 377/805] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:15 2022] GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:18.122646 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-9aa174c7-d9a5-4e59-8ff5-5269ac8ee22e req-810be5a7-68c3-46fe-8a0c-13561ab27b0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29c1b694-47cb-44ac-951e-6db2dc2437da", "tag": "2b97f078-d722-4799-b3c2-7303b516b2a3"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:29:18.131309 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-9aa174c7-d9a5-4e59-8ff5-5269ac8ee22e req-810be5a7-68c3-46fe-8a0c-13561ab27b0a service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:18.131791 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-9aa174c7-d9a5-4e59-8ff5-5269ac8ee22e req-810be5a7-68c3-46fe-8a0c-13561ab27b0a service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:18.145500 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-9aa174c7-d9a5-4e59-8ff5-5269ac8ee22e req-810be5a7-68c3-46fe-8a0c-13561ab27b0a service nova] Creating event network-changed:2b97f078-d722-4799-b3c2-7303b516b2a3 for instance 29c1b694-47cb-44ac-951e-6db2dc2437da on hv-cinder-84214 May 17 17:29:18.150484 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-9aa174c7-d9a5-4e59-8ff5-5269ac8ee22e req-810be5a7-68c3-46fe-8a0c-13561ab27b0a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031321 May 17 17:29:18.151266 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 429/806] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:29:28.970131 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ce7dea03-1f64-445b-8486-8d2584281c9f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:28.971043 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ce7dea03-1f64-445b-8486-8d2584281c9f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:28.977177 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ce7dea03-1f64-445b-8486-8d2584281c9f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:28.977624 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ce7dea03-1f64-445b-8486-8d2584281c9f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:28.978463 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ce7dea03-1f64-445b-8486-8d2584281c9f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:28.978851 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ce7dea03-1f64-445b-8486-8d2584281c9f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:29.007555 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ce7dea03-1f64-445b-8486-8d2584281c9f tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041359 May 17 17:29:29.008105 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 378/807] 10.222.0.88 () {60 vars in 1342 bytes} [Tue May 17 17:29:28 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:29.065099 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a09d5be4-5c71-43c8-9786-1b9b5e08e0a3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:29.065686 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a09d5be4-5c71-43c8-9786-1b9b5e08e0a3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:29.071810 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a09d5be4-5c71-43c8-9786-1b9b5e08e0a3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:29.077335 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a09d5be4-5c71-43c8-9786-1b9b5e08e0a3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:29.077335 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a09d5be4-5c71-43c8-9786-1b9b5e08e0a3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:29.077335 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a09d5be4-5c71-43c8-9786-1b9b5e08e0a3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:29.097915 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a09d5be4-5c71-43c8-9786-1b9b5e08e0a3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Going to try to terminate instance {{(pid=117612) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:29:29.426309 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a09d5be4-5c71-43c8-9786-1b9b5e08e0a3 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 204 len: 0 microversion: 2.20 time: 0.365711 May 17 17:29:29.426893 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 430/808] 10.222.0.88 () {60 vars in 1279 bytes} [Tue May 17 17:29:29 2022] DELETE /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 17 17:29:29.435080 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b3b6d245-3d9a-46b9-81d4-8103b3636fb4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:29.435729 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b3b6d245-3d9a-46b9-81d4-8103b3636fb4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:29.441722 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b3b6d245-3d9a-46b9-81d4-8103b3636fb4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:29.442171 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b3b6d245-3d9a-46b9-81d4-8103b3636fb4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:29.442961 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b3b6d245-3d9a-46b9-81d4-8103b3636fb4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:29.443395 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b3b6d245-3d9a-46b9-81d4-8103b3636fb4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:29.569818 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b3b6d245-3d9a-46b9-81d4-8103b3636fb4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:29.577965 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b3b6d245-3d9a-46b9-81d4-8103b3636fb4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:29.579526 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b3b6d245-3d9a-46b9-81d4-8103b3636fb4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:29.580668 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b3b6d245-3d9a-46b9-81d4-8103b3636fb4 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1722 microversion: 2.20 time: 0.149478 May 17 17:29:29.581220 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 379/809] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:29:29 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:29:30.600527 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-495238ad-47c3-43b9-8195-740cbf4b081a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:30.601229 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-495238ad-47c3-43b9-8195-740cbf4b081a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:30.607559 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-495238ad-47c3-43b9-8195-740cbf4b081a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:30.608017 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-495238ad-47c3-43b9-8195-740cbf4b081a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:30.608777 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-495238ad-47c3-43b9-8195-740cbf4b081a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:30.609209 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-495238ad-47c3-43b9-8195-740cbf4b081a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:30.733615 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-495238ad-47c3-43b9-8195-740cbf4b081a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:30.741761 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-495238ad-47c3-43b9-8195-740cbf4b081a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:30.743244 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-495238ad-47c3-43b9-8195-740cbf4b081a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:30.744417 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-495238ad-47c3-43b9-8195-740cbf4b081a tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1722 microversion: 2.20 time: 0.148160 May 17 17:29:30.744968 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 431/810] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:29:30 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:29:31.762280 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1be47f46-d77f-4c42-bf6b-01d1f97e9887 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:31.762896 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1be47f46-d77f-4c42-bf6b-01d1f97e9887 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:31.769858 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1be47f46-d77f-4c42-bf6b-01d1f97e9887 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:31.770313 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1be47f46-d77f-4c42-bf6b-01d1f97e9887 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:31.771084 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1be47f46-d77f-4c42-bf6b-01d1f97e9887 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:31.771550 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1be47f46-d77f-4c42-bf6b-01d1f97e9887 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:31.807252 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-480bed07-8056-4bfe-ad00-fc9179099a40 req-fbe811b8-b259-4c03-a8f9-0f1a1e6322be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c833b0fb-2150-403e-a166-d5b80f2025f7", "name": "network-vif-deleted", "tag": "ecb996fe-261e-4301-b89c-b7a116cf273b"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:29:31.816509 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-480bed07-8056-4bfe-ad00-fc9179099a40 req-fbe811b8-b259-4c03-a8f9-0f1a1e6322be service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:31.816945 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-480bed07-8056-4bfe-ad00-fc9179099a40 req-fbe811b8-b259-4c03-a8f9-0f1a1e6322be service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:31.828762 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-480bed07-8056-4bfe-ad00-fc9179099a40 req-fbe811b8-b259-4c03-a8f9-0f1a1e6322be service nova] Creating event network-vif-deleted:ecb996fe-261e-4301-b89c-b7a116cf273b for instance c833b0fb-2150-403e-a166-d5b80f2025f7 on hv-cinder-84214 May 17 17:29:31.833724 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-480bed07-8056-4bfe-ad00-fc9179099a40 req-fbe811b8-b259-4c03-a8f9-0f1a1e6322be service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029912 May 17 17:29:31.834972 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 432/811] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:29:31.838541 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-1be47f46-d77f-4c42-bf6b-01d1f97e9887 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:31.849740 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-1be47f46-d77f-4c42-bf6b-01d1f97e9887 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:31.851370 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-1be47f46-d77f-4c42-bf6b-01d1f97e9887 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49df2bc670324cd088691b8d20fcedab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649dd5d80f4142289f94ccd21ab4d68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:31.852818 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1be47f46-d77f-4c42-bf6b-01d1f97e9887 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 200 len: 1655 microversion: 2.20 time: 0.094489 May 17 17:29:31.859551 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 380/812] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:29:31 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 1655 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 17:29:32.872010 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7970c525-fc7f-4ab9-a52a-c44c8b77252e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:32.872730 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-7970c525-fc7f-4ab9-a52a-c44c8b77252e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:32.879568 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7970c525-fc7f-4ab9-a52a-c44c8b77252e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:32.880022 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7970c525-fc7f-4ab9-a52a-c44c8b77252e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:32.880778 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7970c525-fc7f-4ab9-a52a-c44c8b77252e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:32.881235 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7970c525-fc7f-4ab9-a52a-c44c8b77252e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:32.894703 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-7970c525-fc7f-4ab9-a52a-c44c8b77252e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] HTTP exception thrown: Instance c833b0fb-2150-403e-a166-d5b80f2025f7 could not be found. May 17 17:29:32.896907 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7970c525-fc7f-4ab9-a52a-c44c8b77252e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Request method failure captured: May 17 17:29:32.896907 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: request: GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 HTTP/1.1 May 17 17:29:32.896907 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 17 17:29:32.896907 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 17 17:29:32.896907 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Connection: close May 17 17:29:32.896907 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 17 17:29:32.896907 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 17 17:29:32.896907 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.88 May 17 17:29:32.896907 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 17 17:29:32.896907 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 17 17:29:32.896907 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABig9nB1u3VZxRBW4qiid6zfFnMppvMGcutqckgTWhIekYL5_z6ELw3rZ_Ot4qeHDSK2aYicgR0Zzp-jRo2FFkFWut5usmQybdjLoz0yEb9hNIxY1fK9I36uRLakCGm5QG71BnddDxCsyBhCe4rlW0CvKKqOtKk8JxyGI3Qsnw4EsyL_wA May 17 17:29:32.896907 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 17 17:29:32.896907 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 17 17:29:32.896907 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 17 17:29:32.896907 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 17 17:29:32.896907 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Openstack-Nova-Api-Version: 2.20 May 17 17:29:32.896907 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 17 17:29:32.896907 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 17 17:29:32.896907 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 649dd5d80f4142289f94ccd21ab4d68f May 17 17:29:32.896907 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1654364309 May 17 17:29:32.896907 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Role: reader,member May 17 17:29:32.896907 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Roles: reader,member May 17 17:29:32.898369 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/649dd5d80f4142289f94ccd21ab4d68f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/649dd5d80f4142289f94ccd21ab4d68f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/649dd5d80f4142289f94ccd21ab4d68f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_649dd5d80f4142289f94ccd21ab4d68f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:29:32.898369 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1654364309 May 17 17:29:32.898369 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 649dd5d80f4142289f94ccd21ab4d68f May 17 17:29:32.898369 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1654364309 May 17 17:29:32.898369 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeShelveTestJSON-1654364309-project May 17 17:29:32.898369 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 17 17:29:32.898369 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 17 17:29:32.898369 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Id: 49df2bc670324cd088691b8d20fcedab May 17 17:29:32.898369 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1654364309-project May 17 17:29:32.898369 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: method: > May 17 17:29:32.898369 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: exception: Instance c833b0fb-2150-403e-a166-d5b80f2025f7 could not be found. May 17 17:29:32.898369 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: action_args: {'id': 'c833b0fb-2150-403e-a166-d5b80f2025f7'} May 17 17:29:32.899168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:29:32.899168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:29:32.899168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:29:32.899168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:29:32.899168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:29:32.899168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:29:32.899168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:29:32.899168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:29:32.899168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:29:32.899168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:29:32.899168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c833b0fb-2150-403e-a166-d5b80f2025f7 could not be found. May 17 17:29:32.899168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:29:32.899168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:29:32.899168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:29:32.899168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:29:32.899168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:29:32.899168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:29:32.899168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:29:32.899168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:29:32.899168 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:29:32.900714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:29:32.900714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:29:32.900714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:29:32.900714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:29:32.900714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:29:32.900714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:29:32.900714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:29:32.900714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c833b0fb-2150-403e-a166-d5b80f2025f7 could not be found. May 17 17:29:32.900714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:29:32.900714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:29:32.900714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:29:32.900714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:29:32.900714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:29:32.900714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:29:32.900714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:29:32.900714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:29:32.900714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c833b0fb-2150-403e-a166-d5b80f2025f7 could not be found. May 17 17:29:32.900714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:29:32.902082 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7970c525-fc7f-4ab9-a52a-c44c8b77252e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Returning 404 to user: Instance c833b0fb-2150-403e-a166-d5b80f2025f7 could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:29:32.902082 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7970c525-fc7f-4ab9-a52a-c44c8b77252e tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 404 len: 111 microversion: 2.20 time: 0.031154 May 17 17:29:32.902082 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 433/813] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:29:32 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 17:29:32.907304 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5d9d857e-3f6a-4c6f-8903-b0829aa3efa5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '.version_select at 0x7f73cb7859d0>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:32.994984 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5d9d857e-3f6a-4c6f-8903-b0829aa3efa5 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-367532853" status: 204 len: 0 microversion: 2.20 time: 0.091475 May 17 17:29:32.995567 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 381/814] 10.222.0.88 () {60 vars in 1258 bytes} [Tue May 17 17:29:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-367532853 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 17 17:29:34.937057 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-39c7d036-0d9f-4163-971e-413cf33a4131 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:34.937574 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-39c7d036-0d9f-4163-971e-413cf33a4131 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:34.943462 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-39c7d036-0d9f-4163-971e-413cf33a4131 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:34.943947 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-39c7d036-0d9f-4163-971e-413cf33a4131 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:34.944705 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-39c7d036-0d9f-4163-971e-413cf33a4131 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:34.945137 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-39c7d036-0d9f-4163-971e-413cf33a4131 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:34.957858 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-39c7d036-0d9f-4163-971e-413cf33a4131 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] HTTP exception thrown: Instance c833b0fb-2150-403e-a166-d5b80f2025f7 could not be found. May 17 17:29:34.959351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-39c7d036-0d9f-4163-971e-413cf33a4131 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Request method failure captured: May 17 17:29:34.959351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: request: DELETE /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 HTTP/1.1 May 17 17:29:34.959351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 17 17:29:34.959351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 17 17:29:34.959351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Connection: close May 17 17:29:34.959351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 17 17:29:34.959351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 17 17:29:34.959351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.88 May 17 17:29:34.959351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 17 17:29:34.959351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 17 17:29:34.959351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABig9nB1u3VZxRBW4qiid6zfFnMppvMGcutqckgTWhIekYL5_z6ELw3rZ_Ot4qeHDSK2aYicgR0Zzp-jRo2FFkFWut5usmQybdjLoz0yEb9hNIxY1fK9I36uRLakCGm5QG71BnddDxCsyBhCe4rlW0CvKKqOtKk8JxyGI3Qsnw4EsyL_wA May 17 17:29:34.959351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 17 17:29:34.959351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 17 17:29:34.959351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 17 17:29:34.959351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 17 17:29:34.959351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Openstack-Nova-Api-Version: 2.20 May 17 17:29:34.959351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 17 17:29:34.959351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 17 17:29:34.959351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 649dd5d80f4142289f94ccd21ab4d68f May 17 17:29:34.959351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1654364309 May 17 17:29:34.959351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Role: reader,member May 17 17:29:34.959351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Roles: reader,member May 17 17:29:34.961097 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/649dd5d80f4142289f94ccd21ab4d68f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/649dd5d80f4142289f94ccd21ab4d68f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/649dd5d80f4142289f94ccd21ab4d68f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_649dd5d80f4142289f94ccd21ab4d68f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:29:34.961097 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1654364309 May 17 17:29:34.961097 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 649dd5d80f4142289f94ccd21ab4d68f May 17 17:29:34.961097 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1654364309 May 17 17:29:34.961097 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeShelveTestJSON-1654364309-project May 17 17:29:34.961097 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 17 17:29:34.961097 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 17 17:29:34.961097 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Id: 49df2bc670324cd088691b8d20fcedab May 17 17:29:34.961097 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1654364309-project May 17 17:29:34.961097 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: method: > May 17 17:29:34.961097 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: exception: Instance c833b0fb-2150-403e-a166-d5b80f2025f7 could not be found. May 17 17:29:34.961097 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: action_args: {'id': 'c833b0fb-2150-403e-a166-d5b80f2025f7'} May 17 17:29:34.962138 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:29:34.962138 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:29:34.962138 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:29:34.962138 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:29:34.962138 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:29:34.962138 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:29:34.962138 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:29:34.962138 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:29:34.962138 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:29:34.962138 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:29:34.962138 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c833b0fb-2150-403e-a166-d5b80f2025f7 could not be found. May 17 17:29:34.962138 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:29:34.962138 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:29:34.962138 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:29:34.962138 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:29:34.962138 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:29:34.962138 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:29:34.962138 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:29:34.962138 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:29:34.962138 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:29:34.963715 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:29:34.963715 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 17:29:34.963715 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 17:29:34.963715 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 17:29:34.963715 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 17:29:34.963715 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:29:34.963715 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:29:34.963715 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:29:34.963715 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:29:34.963715 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c833b0fb-2150-403e-a166-d5b80f2025f7 could not be found. May 17 17:29:34.963715 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:29:34.963715 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:29:34.963715 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:29:34.963715 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:29:34.963715 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:29:34.963715 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:29:34.963715 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:29:34.963715 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:29:34.963715 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c833b0fb-2150-403e-a166-d5b80f2025f7 could not be found. May 17 17:29:34.963715 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:29:34.965179 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-39c7d036-0d9f-4163-971e-413cf33a4131 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Returning 404 to user: Instance c833b0fb-2150-403e-a166-d5b80f2025f7 could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:29:34.965179 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-39c7d036-0d9f-4163-971e-413cf33a4131 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 404 len: 111 microversion: 2.20 time: 0.028192 May 17 17:29:34.965179 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 434/815] 10.222.0.88 () {60 vars in 1279 bytes} [Tue May 17 17:29:34 2022] DELETE /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 17 17:29:34.970234 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-2a39a880-dc61-486e-8d63-2e67f5506cdd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:34.970939 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-2a39a880-dc61-486e-8d63-2e67f5506cdd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: c833b0fb-2150-403e-a166-d5b80f2025f7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:34.978112 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2a39a880-dc61-486e-8d63-2e67f5506cdd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:34.978560 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2a39a880-dc61-486e-8d63-2e67f5506cdd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:34.979324 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2a39a880-dc61-486e-8d63-2e67f5506cdd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:34.979782 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2a39a880-dc61-486e-8d63-2e67f5506cdd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:34.993109 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-2a39a880-dc61-486e-8d63-2e67f5506cdd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] HTTP exception thrown: Instance c833b0fb-2150-403e-a166-d5b80f2025f7 could not be found. May 17 17:29:34.994733 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-2a39a880-dc61-486e-8d63-2e67f5506cdd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Request method failure captured: May 17 17:29:34.994733 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 HTTP/1.1 May 17 17:29:34.994733 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:29:34.994733 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:29:34.994733 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:29:34.994733 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:29:34.994733 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:29:34.994733 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:29:34.994733 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:29:34.994733 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:29:34.994733 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9nB1u3VZxRBW4qiid6zfFnMppvMGcutqckgTWhIekYL5_z6ELw3rZ_Ot4qeHDSK2aYicgR0Zzp-jRo2FFkFWut5usmQybdjLoz0yEb9hNIxY1fK9I36uRLakCGm5QG71BnddDxCsyBhCe4rlW0CvKKqOtKk8JxyGI3Qsnw4EsyL_wA May 17 17:29:34.994733 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:29:34.994733 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:29:34.994733 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:29:34.994733 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:29:34.994733 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Openstack-Nova-Api-Version: 2.20 May 17 17:29:34.994733 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:29:34.994733 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:29:34.994733 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: 649dd5d80f4142289f94ccd21ab4d68f May 17 17:29:34.994733 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1654364309 May 17 17:29:34.994733 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:29:34.994733 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:29:34.996374 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/649dd5d80f4142289f94ccd21ab4d68f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/649dd5d80f4142289f94ccd21ab4d68f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/649dd5d80f4142289f94ccd21ab4d68f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_649dd5d80f4142289f94ccd21ab4d68f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:29:34.996374 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1654364309 May 17 17:29:34.996374 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: 649dd5d80f4142289f94ccd21ab4d68f May 17 17:29:34.996374 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1654364309 May 17 17:29:34.996374 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-AttachVolumeShelveTestJSON-1654364309-project May 17 17:29:34.996374 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:29:34.996374 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:29:34.996374 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 49df2bc670324cd088691b8d20fcedab May 17 17:29:34.996374 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1654364309-project May 17 17:29:34.996374 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:29:34.996374 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Instance c833b0fb-2150-403e-a166-d5b80f2025f7 could not be found. May 17 17:29:34.996374 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': 'c833b0fb-2150-403e-a166-d5b80f2025f7'} May 17 17:29:34.997416 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:29:34.997416 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:29:34.997416 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:29:34.997416 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:29:34.997416 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:29:34.997416 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:29:34.997416 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:29:34.997416 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:29:34.997416 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:29:34.997416 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:29:34.997416 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c833b0fb-2150-403e-a166-d5b80f2025f7 could not be found. May 17 17:29:34.997416 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:29:34.997416 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:29:34.997416 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:29:34.997416 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:29:34.997416 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:29:34.997416 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:29:34.997416 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:29:34.997416 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:29:34.997416 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:29:34.999479 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:29:34.999479 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:29:34.999479 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:29:34.999479 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:29:34.999479 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:29:34.999479 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:29:34.999479 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:29:34.999479 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c833b0fb-2150-403e-a166-d5b80f2025f7 could not be found. May 17 17:29:34.999479 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:29:34.999479 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:29:34.999479 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:29:34.999479 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:29:34.999479 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:29:34.999479 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:29:34.999479 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:29:34.999479 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:29:34.999479 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c833b0fb-2150-403e-a166-d5b80f2025f7 could not be found. May 17 17:29:34.999479 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:29:35.001130 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-2a39a880-dc61-486e-8d63-2e67f5506cdd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Returning 404 to user: Instance c833b0fb-2150-403e-a166-d5b80f2025f7 could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:29:35.001130 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-2a39a880-dc61-486e-8d63-2e67f5506cdd tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7" status: 404 len: 111 microversion: 2.20 time: 0.030268 May 17 17:29:35.001130 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 382/816] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:29:34 2022] GET /compute/v2.1/servers/c833b0fb-2150-403e-a166-d5b80f2025f7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 17:29:36.250416 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-915f1f05-f25c-45fb-871c-2a2c2f85c42b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:36.250936 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-915f1f05-f25c-45fb-871c-2a2c2f85c42b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:36.257237 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-915f1f05-f25c-45fb-871c-2a2c2f85c42b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:36.257685 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-915f1f05-f25c-45fb-871c-2a2c2f85c42b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:36.258442 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-915f1f05-f25c-45fb-871c-2a2c2f85c42b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:36.258872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-915f1f05-f25c-45fb-871c-2a2c2f85c42b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:36.271698 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-915f1f05-f25c-45fb-871c-2a2c2f85c42b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] HTTP exception thrown: Instance bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 could not be found. May 17 17:29:36.273203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-915f1f05-f25c-45fb-871c-2a2c2f85c42b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Request method failure captured: May 17 17:29:36.273203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: request: DELETE /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 HTTP/1.1 May 17 17:29:36.273203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 17 17:29:36.273203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 17 17:29:36.273203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Connection: close May 17 17:29:36.273203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 17 17:29:36.273203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 17 17:29:36.273203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.88 May 17 17:29:36.273203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 17 17:29:36.273203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 17 17:29:36.273203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABig9nB1u3VZxRBW4qiid6zfFnMppvMGcutqckgTWhIekYL5_z6ELw3rZ_Ot4qeHDSK2aYicgR0Zzp-jRo2FFkFWut5usmQybdjLoz0yEb9hNIxY1fK9I36uRLakCGm5QG71BnddDxCsyBhCe4rlW0CvKKqOtKk8JxyGI3Qsnw4EsyL_wA May 17 17:29:36.273203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 17 17:29:36.273203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 17 17:29:36.273203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 17 17:29:36.273203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 17 17:29:36.273203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Openstack-Nova-Api-Version: 2.20 May 17 17:29:36.273203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 17 17:29:36.273203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 17 17:29:36.273203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 649dd5d80f4142289f94ccd21ab4d68f May 17 17:29:36.273203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1654364309 May 17 17:29:36.273203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Role: reader,member May 17 17:29:36.273203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Roles: reader,member May 17 17:29:36.274817 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/649dd5d80f4142289f94ccd21ab4d68f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/649dd5d80f4142289f94ccd21ab4d68f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/649dd5d80f4142289f94ccd21ab4d68f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_649dd5d80f4142289f94ccd21ab4d68f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:29:36.274817 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1654364309 May 17 17:29:36.274817 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 649dd5d80f4142289f94ccd21ab4d68f May 17 17:29:36.274817 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1654364309 May 17 17:29:36.274817 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeShelveTestJSON-1654364309-project May 17 17:29:36.274817 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 17 17:29:36.274817 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 17 17:29:36.274817 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Id: 49df2bc670324cd088691b8d20fcedab May 17 17:29:36.274817 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1654364309-project May 17 17:29:36.274817 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: method: > May 17 17:29:36.274817 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: exception: Instance bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 could not be found. May 17 17:29:36.274817 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: action_args: {'id': 'bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44'} May 17 17:29:36.275714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:29:36.275714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:29:36.275714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:29:36.275714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:29:36.275714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:29:36.275714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:29:36.275714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:29:36.275714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:29:36.275714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:29:36.275714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:29:36.275714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 could not be found. May 17 17:29:36.275714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:29:36.275714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:29:36.275714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:29:36.275714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:29:36.275714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:29:36.275714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:29:36.275714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:29:36.275714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:29:36.275714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:29:36.277236 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:29:36.277236 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 17:29:36.277236 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 17:29:36.277236 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 17:29:36.277236 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 17:29:36.277236 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:29:36.277236 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:29:36.277236 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:29:36.277236 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:29:36.277236 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 could not be found. May 17 17:29:36.277236 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:29:36.277236 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:29:36.277236 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:29:36.277236 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:29:36.277236 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:29:36.277236 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:29:36.277236 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:29:36.277236 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:29:36.277236 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 could not be found. May 17 17:29:36.277236 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:29:36.278720 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-915f1f05-f25c-45fb-871c-2a2c2f85c42b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Returning 404 to user: Instance bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:29:36.278720 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-915f1f05-f25c-45fb-871c-2a2c2f85c42b tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "DELETE /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 404 len: 111 microversion: 2.20 time: 0.028583 May 17 17:29:36.278720 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 435/817] 10.222.0.88 () {60 vars in 1279 bytes} [Tue May 17 17:29:36 2022] DELETE /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 17:29:36.282604 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-9675bec2-893d-44dd-b93d-c91b14d568d1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:36.283212 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-9675bec2-893d-44dd-b93d-c91b14d568d1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] [instance: bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:36.289808 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9675bec2-893d-44dd-b93d-c91b14d568d1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:36.290253 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9675bec2-893d-44dd-b93d-c91b14d568d1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:36.291049 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9675bec2-893d-44dd-b93d-c91b14d568d1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:36.291482 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9675bec2-893d-44dd-b93d-c91b14d568d1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:36.305490 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-9675bec2-893d-44dd-b93d-c91b14d568d1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] HTTP exception thrown: Instance bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 could not be found. May 17 17:29:36.307003 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-9675bec2-893d-44dd-b93d-c91b14d568d1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Request method failure captured: May 17 17:29:36.307003 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 HTTP/1.1 May 17 17:29:36.307003 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:29:36.307003 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:29:36.307003 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:29:36.307003 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:29:36.307003 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:29:36.307003 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:29:36.307003 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:29:36.307003 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:29:36.307003 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9nB1u3VZxRBW4qiid6zfFnMppvMGcutqckgTWhIekYL5_z6ELw3rZ_Ot4qeHDSK2aYicgR0Zzp-jRo2FFkFWut5usmQybdjLoz0yEb9hNIxY1fK9I36uRLakCGm5QG71BnddDxCsyBhCe4rlW0CvKKqOtKk8JxyGI3Qsnw4EsyL_wA May 17 17:29:36.307003 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:29:36.307003 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:29:36.307003 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:29:36.307003 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:29:36.307003 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Openstack-Nova-Api-Version: 2.20 May 17 17:29:36.307003 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:29:36.307003 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:29:36.307003 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: 649dd5d80f4142289f94ccd21ab4d68f May 17 17:29:36.307003 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1654364309 May 17 17:29:36.307003 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:29:36.307003 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:29:36.308632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/649dd5d80f4142289f94ccd21ab4d68f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/649dd5d80f4142289f94ccd21ab4d68f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/649dd5d80f4142289f94ccd21ab4d68f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_649dd5d80f4142289f94ccd21ab4d68f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:29:36.308632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1654364309 May 17 17:29:36.308632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: 649dd5d80f4142289f94ccd21ab4d68f May 17 17:29:36.308632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1654364309 May 17 17:29:36.308632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-AttachVolumeShelveTestJSON-1654364309-project May 17 17:29:36.308632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:29:36.308632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:29:36.308632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 49df2bc670324cd088691b8d20fcedab May 17 17:29:36.308632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1654364309-project May 17 17:29:36.308632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:29:36.308632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Instance bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 could not be found. May 17 17:29:36.308632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': 'bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44'} May 17 17:29:36.309519 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:29:36.309519 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:29:36.309519 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:29:36.309519 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:29:36.309519 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:29:36.309519 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:29:36.309519 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:29:36.309519 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:29:36.309519 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:29:36.309519 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:29:36.309519 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 could not be found. May 17 17:29:36.309519 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:29:36.309519 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:29:36.309519 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:29:36.309519 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:29:36.309519 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:29:36.309519 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:29:36.309519 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:29:36.309519 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:29:36.309519 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:29:36.310943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:29:36.310943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:29:36.310943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:29:36.310943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:29:36.310943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:29:36.310943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:29:36.310943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:29:36.310943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 could not be found. May 17 17:29:36.310943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:29:36.310943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:29:36.310943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:29:36.310943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:29:36.310943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:29:36.310943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:29:36.310943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:29:36.310943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:29:36.310943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 could not be found. May 17 17:29:36.310943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:29:36.312983 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-9675bec2-893d-44dd-b93d-c91b14d568d1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] Returning 404 to user: Instance bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:29:36.312983 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-9675bec2-893d-44dd-b93d-c91b14d568d1 tempest-AttachVolumeShelveTestJSON-1654364309 tempest-AttachVolumeShelveTestJSON-1654364309-project] 10.222.0.88 "GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44" status: 404 len: 111 microversion: 2.20 time: 0.029611 May 17 17:29:36.312983 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 383/818] 10.222.0.88 () {60 vars in 1276 bytes} [Tue May 17 17:29:36 2022] GET /compute/v2.1/servers/bc0c26fc-0c1a-4bc9-8ce0-d2d5a4e2bd44 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 17:29:55.150494 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-92a472eb-f531-446c-83f3-68684f149940 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1558149398", "imageRef": "800c492c-ff69-4735-b2c9-a2dcaa20aa8d", "flavorRef": "452"}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:29:55.199580 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.network.neutron [None req-92a472eb-f531-446c-83f3-68684f149940 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] validate_networks() for None {{(pid=117612) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:29:55.712237 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-92a472eb-f531-446c-83f3-68684f149940 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Flavor limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:29:55.712656 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-92a472eb-f531-446c-83f3-68684f149940 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Image limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:29:55.713124 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-92a472eb-f531-446c-83f3-68684f149940 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Flavor pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:29:55.713529 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-92a472eb-f531-446c-83f3-68684f149940 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Image pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:29:55.713934 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-92a472eb-f531-446c-83f3-68684f149940 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:29:55.722903 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-92a472eb-f531-446c-83f3-68684f149940 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:55.723344 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-92a472eb-f531-446c-83f3-68684f149940 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:55.724182 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-92a472eb-f531-446c-83f3-68684f149940 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:55.724612 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-92a472eb-f531-446c-83f3-68684f149940 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:55.740615 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-92a472eb-f531-446c-83f3-68684f149940 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Getting quotas for project 348519643baf4649be43dd14d4cd7cc2. Resources: {'cores', 'ram', 'instances'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:29:55.744547 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-92a472eb-f531-446c-83f3-68684f149940 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Getting quotas for user 101123f181a2446c84ddef2e98ace2e3 and project 348519643baf4649be43dd14d4cd7cc2. Resources: {'cores', 'ram', 'instances'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:29:55.755003 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-92a472eb-f531-446c-83f3-68684f149940 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Going to run 1 instances... {{(pid=117612) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:29:55.757223 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-92a472eb-f531-446c-83f3-68684f149940 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] [instance: 96e1c662-e82a-421f-90ae-3388aa87cc4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='800c492c-ff69-4735-b2c9-a2dcaa20aa8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:29:55.866301 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-92a472eb-f531-446c-83f3-68684f149940 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719503 May 17 17:29:55.866935 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 436/819] 10.222.0.88 () {60 vars in 1146 bytes} [Tue May 17 17:29:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:29:55.877614 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d15c8475-afd9-42ae-a072-01369d782f21 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:55.878333 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d15c8475-afd9-42ae-a072-01369d782f21 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] [instance: 96e1c662-e82a-421f-90ae-3388aa87cc4b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:55.929990 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d15c8475-afd9-42ae-a072-01369d782f21 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101123f181a2446c84ddef2e98ace2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348519643baf4649be43dd14d4cd7cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:55.936980 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d15c8475-afd9-42ae-a072-01369d782f21 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] 10.222.0.88 "GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b" status: 200 len: 1215 microversion: 2.1 time: 0.063997 May 17 17:29:55.937544 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 384/820] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:55 2022] GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b => generated 1215 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:56.953518 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a45391a1-2d96-4d92-95bb-6de4b9bed10c tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:56.954760 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a45391a1-2d96-4d92-95bb-6de4b9bed10c tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] [instance: 96e1c662-e82a-421f-90ae-3388aa87cc4b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:56.961325 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a45391a1-2d96-4d92-95bb-6de4b9bed10c tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:56.966649 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a45391a1-2d96-4d92-95bb-6de4b9bed10c tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:56.966649 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a45391a1-2d96-4d92-95bb-6de4b9bed10c tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:56.966649 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a45391a1-2d96-4d92-95bb-6de4b9bed10c tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:57.025579 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a45391a1-2d96-4d92-95bb-6de4b9bed10c tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101123f181a2446c84ddef2e98ace2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348519643baf4649be43dd14d4cd7cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:57.033215 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a45391a1-2d96-4d92-95bb-6de4b9bed10c tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] 10.222.0.88 "GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b" status: 200 len: 1219 microversion: 2.1 time: 0.084044 May 17 17:29:57.033796 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 437/821] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:56 2022] GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:57.782198 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-91c30fa1-b239-4dac-81bb-0bb2d3bddcb6 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:57.782810 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-91c30fa1-b239-4dac-81bb-0bb2d3bddcb6 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:57.789970 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-91c30fa1-b239-4dac-81bb-0bb2d3bddcb6 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:57.790417 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-91c30fa1-b239-4dac-81bb-0bb2d3bddcb6 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:57.791191 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-91c30fa1-b239-4dac-81bb-0bb2d3bddcb6 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:57.791660 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-91c30fa1-b239-4dac-81bb-0bb2d3bddcb6 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:57.813893 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-91c30fa1-b239-4dac-81bb-0bb2d3bddcb6 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690/ips" status: 200 len: 150 microversion: 2.1 time: 0.035998 May 17 17:29:57.814456 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 385/822] 10.222.0.88 () {58 vars in 1247 bytes} [Tue May 17 17:29:57 2022] GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:29:58.050721 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-dea294d0-3e5c-4e85-9a8a-42237a909d8a tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:58.051329 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-dea294d0-3e5c-4e85-9a8a-42237a909d8a tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] [instance: 96e1c662-e82a-421f-90ae-3388aa87cc4b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:58.057708 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-dea294d0-3e5c-4e85-9a8a-42237a909d8a tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:58.058437 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-dea294d0-3e5c-4e85-9a8a-42237a909d8a tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:58.059470 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-dea294d0-3e5c-4e85-9a8a-42237a909d8a tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:58.060043 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-dea294d0-3e5c-4e85-9a8a-42237a909d8a tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:58.131852 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-dea294d0-3e5c-4e85-9a8a-42237a909d8a tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101123f181a2446c84ddef2e98ace2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348519643baf4649be43dd14d4cd7cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:58.139253 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-dea294d0-3e5c-4e85-9a8a-42237a909d8a tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] 10.222.0.88 "GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b" status: 200 len: 1275 microversion: 2.1 time: 0.092182 May 17 17:29:58.139840 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 438/823] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:58 2022] GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b => generated 1275 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:29:59.157086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b72d5474-e85c-4b86-ab09-28113b5c052c tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:29:59.157707 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b72d5474-e85c-4b86-ab09-28113b5c052c tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] [instance: 96e1c662-e82a-421f-90ae-3388aa87cc4b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:59.164334 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b72d5474-e85c-4b86-ab09-28113b5c052c tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:59.165008 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b72d5474-e85c-4b86-ab09-28113b5c052c tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:59.166011 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b72d5474-e85c-4b86-ab09-28113b5c052c tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:59.166555 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b72d5474-e85c-4b86-ab09-28113b5c052c tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:59.327241 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b72d5474-e85c-4b86-ab09-28113b5c052c tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101123f181a2446c84ddef2e98ace2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348519643baf4649be43dd14d4cd7cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:29:59.335175 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b72d5474-e85c-4b86-ab09-28113b5c052c tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] 10.222.0.88 "GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b" status: 200 len: 1315 microversion: 2.1 time: 0.182394 May 17 17:29:59.335904 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 386/824] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:29:59 2022] GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:29:59.525133 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5541b7d1-cde0-4808-bb41-20a52eee7a35 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54f1bbe6-8792-4536-ba9e-f2b484047f3e"}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:29:59.526245 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5541b7d1-cde0-4808-bb41-20a52eee7a35 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:29:59.532634 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5541b7d1-cde0-4808-bb41-20a52eee7a35 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:59.533080 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5541b7d1-cde0-4808-bb41-20a52eee7a35 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:59.533873 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5541b7d1-cde0-4808-bb41-20a52eee7a35 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:59.534306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5541b7d1-cde0-4808-bb41-20a52eee7a35 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:59.955594 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-3faece4a-a1c3-476e-9a2d-652cb235c414 req-f6282dd0-b8a3-4b85-97c0-617c3e17725d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96e1c662-e82a-421f-90ae-3388aa87cc4b", "tag": "ca1eeda9-4c99-4ff5-a63d-63f588289dea"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:29:59.963726 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-3faece4a-a1c3-476e-9a2d-652cb235c414 req-f6282dd0-b8a3-4b85-97c0-617c3e17725d service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:29:59.964170 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-3faece4a-a1c3-476e-9a2d-652cb235c414 req-f6282dd0-b8a3-4b85-97c0-617c3e17725d service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:29:59.979003 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-3faece4a-a1c3-476e-9a2d-652cb235c414 req-f6282dd0-b8a3-4b85-97c0-617c3e17725d service nova] Creating event network-changed:ca1eeda9-4c99-4ff5-a63d-63f588289dea for instance 96e1c662-e82a-421f-90ae-3388aa87cc4b on hv-cinder-84214 May 17 17:29:59.993152 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-3faece4a-a1c3-476e-9a2d-652cb235c414 req-f6282dd0-b8a3-4b85-97c0-617c3e17725d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040528 May 17 17:29:59.994732 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 387/825] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:30:00.349941 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5541b7d1-cde0-4808-bb41-20a52eee7a35 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "POST /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.828562 May 17 17:30:00.350841 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 439/826] 10.222.0.88 () {60 vars in 1322 bytes} [Tue May 17 17:29:59 2022] POST /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690/os-volume_attachments => generated 194 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:30:00.355440 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ab1c1805-8d75-423b-871c-73b5ee7b10a7 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:30:00.362625 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ab1c1805-8d75-423b-871c-73b5ee7b10a7 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] [instance: 96e1c662-e82a-421f-90ae-3388aa87cc4b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:30:00.377016 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ab1c1805-8d75-423b-871c-73b5ee7b10a7 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:00.377477 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ab1c1805-8d75-423b-871c-73b5ee7b10a7 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:00.379769 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ab1c1805-8d75-423b-871c-73b5ee7b10a7 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:00.379769 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ab1c1805-8d75-423b-871c-73b5ee7b10a7 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:00.531015 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ab1c1805-8d75-423b-871c-73b5ee7b10a7 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101123f181a2446c84ddef2e98ace2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348519643baf4649be43dd14d4cd7cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:30:00.539996 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ab1c1805-8d75-423b-871c-73b5ee7b10a7 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] 10.222.0.88 "GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b" status: 200 len: 1315 microversion: 2.1 time: 0.190443 May 17 17:30:00.540762 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 388/827] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:30:00 2022] GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:30:01.558254 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8977b973-148c-4433-a1c6-0a526c3d38b7 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:30:01.558956 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8977b973-148c-4433-a1c6-0a526c3d38b7 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] [instance: 96e1c662-e82a-421f-90ae-3388aa87cc4b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:30:01.565529 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8977b973-148c-4433-a1c6-0a526c3d38b7 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:01.565978 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8977b973-148c-4433-a1c6-0a526c3d38b7 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:01.570278 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8977b973-148c-4433-a1c6-0a526c3d38b7 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:01.570278 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8977b973-148c-4433-a1c6-0a526c3d38b7 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:01.696948 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8977b973-148c-4433-a1c6-0a526c3d38b7 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101123f181a2446c84ddef2e98ace2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348519643baf4649be43dd14d4cd7cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:30:01.704378 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8977b973-148c-4433-a1c6-0a526c3d38b7 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] 10.222.0.88 "GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b" status: 200 len: 1315 microversion: 2.1 time: 0.150708 May 17 17:30:01.704964 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 440/828] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:30:01 2022] GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:30:02.721735 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-51053ae7-7e21-4d4a-a543-6bd8d8277e62 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:30:02.722338 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-51053ae7-7e21-4d4a-a543-6bd8d8277e62 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] [instance: 96e1c662-e82a-421f-90ae-3388aa87cc4b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:30:02.728611 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-51053ae7-7e21-4d4a-a543-6bd8d8277e62 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:02.729058 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-51053ae7-7e21-4d4a-a543-6bd8d8277e62 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:02.729823 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-51053ae7-7e21-4d4a-a543-6bd8d8277e62 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:02.730258 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-51053ae7-7e21-4d4a-a543-6bd8d8277e62 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:02.860943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-51053ae7-7e21-4d4a-a543-6bd8d8277e62 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101123f181a2446c84ddef2e98ace2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348519643baf4649be43dd14d4cd7cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:30:02.868376 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-51053ae7-7e21-4d4a-a543-6bd8d8277e62 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] 10.222.0.88 "GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b" status: 200 len: 1315 microversion: 2.1 time: 0.150447 May 17 17:30:02.868933 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 389/829] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:30:02 2022] GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:30:03.885712 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-39573672-0f09-4662-908c-05d935b8ccf4 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:30:03.886321 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-39573672-0f09-4662-908c-05d935b8ccf4 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] [instance: 96e1c662-e82a-421f-90ae-3388aa87cc4b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:30:03.893210 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-39573672-0f09-4662-908c-05d935b8ccf4 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:03.893710 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-39573672-0f09-4662-908c-05d935b8ccf4 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:03.894470 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-39573672-0f09-4662-908c-05d935b8ccf4 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:03.894902 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-39573672-0f09-4662-908c-05d935b8ccf4 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:04.021529 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-39573672-0f09-4662-908c-05d935b8ccf4 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101123f181a2446c84ddef2e98ace2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348519643baf4649be43dd14d4cd7cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:30:04.028679 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-39573672-0f09-4662-908c-05d935b8ccf4 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] 10.222.0.88 "GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b" status: 200 len: 1315 microversion: 2.1 time: 0.146981 May 17 17:30:04.029863 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 441/830] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:30:03 2022] GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:30:05.046745 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-fc57407d-ff5a-4e49-b680-1b15c99bd35c tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:30:05.047357 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-fc57407d-ff5a-4e49-b680-1b15c99bd35c tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] [instance: 96e1c662-e82a-421f-90ae-3388aa87cc4b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:30:05.053739 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fc57407d-ff5a-4e49-b680-1b15c99bd35c tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:05.054187 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fc57407d-ff5a-4e49-b680-1b15c99bd35c tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:05.054946 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fc57407d-ff5a-4e49-b680-1b15c99bd35c tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:05.055381 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fc57407d-ff5a-4e49-b680-1b15c99bd35c tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:05.179957 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-fc57407d-ff5a-4e49-b680-1b15c99bd35c tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101123f181a2446c84ddef2e98ace2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348519643baf4649be43dd14d4cd7cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:30:05.187147 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-fc57407d-ff5a-4e49-b680-1b15c99bd35c tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] 10.222.0.88 "GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b" status: 200 len: 1315 microversion: 2.1 time: 0.144903 May 17 17:30:05.187742 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 390/831] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:30:05 2022] GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:30:05.880426 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-998e0abb-9a39-4500-a065-48db182a78d8 req-edba1b29-d4c5-4b02-b1e9-36a6105275ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e1c662-e82a-421f-90ae-3388aa87cc4b", "name": "network-vif-plugged", "status": "completed", "tag": "ca1eeda9-4c99-4ff5-a63d-63f588289dea"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:30:05.889484 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-998e0abb-9a39-4500-a065-48db182a78d8 req-edba1b29-d4c5-4b02-b1e9-36a6105275ab service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:05.889925 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-998e0abb-9a39-4500-a065-48db182a78d8 req-edba1b29-d4c5-4b02-b1e9-36a6105275ab service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:05.900452 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-998e0abb-9a39-4500-a065-48db182a78d8 req-edba1b29-d4c5-4b02-b1e9-36a6105275ab service nova] Creating event network-vif-plugged:ca1eeda9-4c99-4ff5-a63d-63f588289dea for instance 96e1c662-e82a-421f-90ae-3388aa87cc4b on hv-cinder-84214 May 17 17:30:05.905444 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-998e0abb-9a39-4500-a065-48db182a78d8 req-edba1b29-d4c5-4b02-b1e9-36a6105275ab service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028629 May 17 17:30:05.909182 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 442/832] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:30:06.203322 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3c98a290-ad70-410b-b052-be99a1738e0a tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:30:06.203965 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3c98a290-ad70-410b-b052-be99a1738e0a tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] [instance: 96e1c662-e82a-421f-90ae-3388aa87cc4b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:30:06.210672 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3c98a290-ad70-410b-b052-be99a1738e0a tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:06.211150 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3c98a290-ad70-410b-b052-be99a1738e0a tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:06.211990 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3c98a290-ad70-410b-b052-be99a1738e0a tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:06.212410 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3c98a290-ad70-410b-b052-be99a1738e0a tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:06.341183 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3c98a290-ad70-410b-b052-be99a1738e0a tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101123f181a2446c84ddef2e98ace2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348519643baf4649be43dd14d4cd7cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:30:06.348402 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3c98a290-ad70-410b-b052-be99a1738e0a tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] 10.222.0.88 "GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b" status: 200 len: 1315 microversion: 2.1 time: 0.149057 May 17 17:30:06.348980 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 391/833] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:30:06 2022] GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:30:07.366862 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-affce085-12f5-4e61-9e7d-7ffc6cd85487 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:30:07.367586 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-affce085-12f5-4e61-9e7d-7ffc6cd85487 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] [instance: 96e1c662-e82a-421f-90ae-3388aa87cc4b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:30:07.374410 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-affce085-12f5-4e61-9e7d-7ffc6cd85487 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:07.374863 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-affce085-12f5-4e61-9e7d-7ffc6cd85487 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:07.375704 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-affce085-12f5-4e61-9e7d-7ffc6cd85487 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:07.376147 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-affce085-12f5-4e61-9e7d-7ffc6cd85487 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:07.502976 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-affce085-12f5-4e61-9e7d-7ffc6cd85487 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101123f181a2446c84ddef2e98ace2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348519643baf4649be43dd14d4cd7cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:30:07.512206 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-affce085-12f5-4e61-9e7d-7ffc6cd85487 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] 10.222.0.88 "GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b" status: 200 len: 1315 microversion: 2.1 time: 0.150249 May 17 17:30:07.512776 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 443/834] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:30:07 2022] GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:30:08.529594 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b4d60cf8-be81-4fdb-aa1f-2a458bd7a2a1 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:30:08.530226 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b4d60cf8-be81-4fdb-aa1f-2a458bd7a2a1 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] [instance: 96e1c662-e82a-421f-90ae-3388aa87cc4b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:30:08.536475 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b4d60cf8-be81-4fdb-aa1f-2a458bd7a2a1 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:08.536920 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b4d60cf8-be81-4fdb-aa1f-2a458bd7a2a1 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:08.537941 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b4d60cf8-be81-4fdb-aa1f-2a458bd7a2a1 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:08.538367 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b4d60cf8-be81-4fdb-aa1f-2a458bd7a2a1 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:08.670952 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b4d60cf8-be81-4fdb-aa1f-2a458bd7a2a1 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101123f181a2446c84ddef2e98ace2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348519643baf4649be43dd14d4cd7cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:30:08.678249 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b4d60cf8-be81-4fdb-aa1f-2a458bd7a2a1 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] 10.222.0.88 "GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b" status: 200 len: 1465 microversion: 2.1 time: 0.153091 May 17 17:30:08.678808 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 392/835] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:30:08 2022] GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b => generated 1465 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:30:08.716443 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b18ce705-9f5e-4731-9054-a5de6d8d9be8 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:30:08.716935 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b18ce705-9f5e-4731-9054-a5de6d8d9be8 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] [instance: 96e1c662-e82a-421f-90ae-3388aa87cc4b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:30:08.723091 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b18ce705-9f5e-4731-9054-a5de6d8d9be8 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:08.723576 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b18ce705-9f5e-4731-9054-a5de6d8d9be8 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:08.724333 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b18ce705-9f5e-4731-9054-a5de6d8d9be8 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:08.724767 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b18ce705-9f5e-4731-9054-a5de6d8d9be8 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:08.751993 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b18ce705-9f5e-4731-9054-a5de6d8d9be8 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] [instance: 96e1c662-e82a-421f-90ae-3388aa87cc4b] Going to try to terminate instance {{(pid=117612) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:30:08.879949 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-0e0b5380-52f5-4250-beed-2a977aacaf38 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Action: 'create', calling method: .version_select at 0x7f73cb69c310>, body: {"keypair": {"name": "tempest-keypair-265059586", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNq0eg8+AYaQ48M4t/16HCzr3GSlKnJ/4A6rcUOPeenNermkdJOwHEgouTi31iboYJdzr7N3XeNAT6fXhfqJERHdekFkEO2/kmFwOdAEtuvHgUbNFNflHLWKN43JsQ3mTQ=="}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:30:08.893954 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-0e0b5380-52f5-4250-beed-2a977aacaf38 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Getting quotas for project ed4b8b6a551347b6a920e4cfb59b9480. Resources: {'key_pairs'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:30:08.897833 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-0e0b5380-52f5-4250-beed-2a977aacaf38 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Getting quotas for user 7b22bf1b41774f64b7a380d86ef3f72e and project ed4b8b6a551347b6a920e4cfb59b9480. Resources: {'key_pairs'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:30:08.978579 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-0e0b5380-52f5-4250-beed-2a977aacaf38 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.101742 May 17 17:30:08.979323 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 393/836] 10.222.0.88 () {60 vars in 1158 bytes} [Tue May 17 17:30:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:30:09.063144 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b18ce705-9f5e-4731-9054-a5de6d8d9be8 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] 10.222.0.88 "DELETE /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b" status: 204 len: 0 microversion: 2.1 time: 0.350130 May 17 17:30:09.063692 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 444/837] 10.222.0.88 () {58 vars in 1238 bytes} [Tue May 17 17:30:08 2022] DELETE /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:30:09.071880 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d84308b4-dd1d-418d-a9fe-e9f9a729d789 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:30:09.072488 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d84308b4-dd1d-418d-a9fe-e9f9a729d789 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] [instance: 96e1c662-e82a-421f-90ae-3388aa87cc4b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:30:09.078442 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d84308b4-dd1d-418d-a9fe-e9f9a729d789 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:09.082821 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d84308b4-dd1d-418d-a9fe-e9f9a729d789 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:09.082821 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d84308b4-dd1d-418d-a9fe-e9f9a729d789 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:09.082821 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d84308b4-dd1d-418d-a9fe-e9f9a729d789 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:09.244973 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d84308b4-dd1d-418d-a9fe-e9f9a729d789 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101123f181a2446c84ddef2e98ace2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348519643baf4649be43dd14d4cd7cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:30:09.252376 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d84308b4-dd1d-418d-a9fe-e9f9a729d789 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] 10.222.0.88 "GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b" status: 200 len: 1471 microversion: 2.1 time: 0.184456 May 17 17:30:09.252940 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 394/838] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:30:09 2022] GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b => generated 1471 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:30:10.271724 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0d6d1e6b-fd22-4a7a-8f85-6ea044ee4fca tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:30:10.272524 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0d6d1e6b-fd22-4a7a-8f85-6ea044ee4fca tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] [instance: 96e1c662-e82a-421f-90ae-3388aa87cc4b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:30:10.279106 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0d6d1e6b-fd22-4a7a-8f85-6ea044ee4fca tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:10.279697 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0d6d1e6b-fd22-4a7a-8f85-6ea044ee4fca tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:10.280567 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0d6d1e6b-fd22-4a7a-8f85-6ea044ee4fca tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:10.281008 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0d6d1e6b-fd22-4a7a-8f85-6ea044ee4fca tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:10.486768 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0d6d1e6b-fd22-4a7a-8f85-6ea044ee4fca tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101123f181a2446c84ddef2e98ace2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348519643baf4649be43dd14d4cd7cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:30:10.494237 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0d6d1e6b-fd22-4a7a-8f85-6ea044ee4fca tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] 10.222.0.88 "GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b" status: 200 len: 1471 microversion: 2.1 time: 0.227327 May 17 17:30:10.495052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 445/839] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:30:10 2022] GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b => generated 1471 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:30:10.981602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-54b0af63-6721-4a0c-858b-cca838114167 req-b8a2d77c-3c9f-4e93-8c7d-c1254b02b63f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e1c662-e82a-421f-90ae-3388aa87cc4b", "name": "network-vif-deleted", "tag": "ca1eeda9-4c99-4ff5-a63d-63f588289dea"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:30:10.995383 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-54b0af63-6721-4a0c-858b-cca838114167 req-b8a2d77c-3c9f-4e93-8c7d-c1254b02b63f service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:10.996155 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-54b0af63-6721-4a0c-858b-cca838114167 req-b8a2d77c-3c9f-4e93-8c7d-c1254b02b63f service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:11.010203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-54b0af63-6721-4a0c-858b-cca838114167 req-b8a2d77c-3c9f-4e93-8c7d-c1254b02b63f service nova] Creating event network-vif-deleted:ca1eeda9-4c99-4ff5-a63d-63f588289dea for instance 96e1c662-e82a-421f-90ae-3388aa87cc4b on hv-cinder-84214 May 17 17:30:11.016514 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-54b0af63-6721-4a0c-858b-cca838114167 req-b8a2d77c-3c9f-4e93-8c7d-c1254b02b63f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039460 May 17 17:30:11.017178 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 395/840] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:30:11.512104 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2ea9d442-d108-4d7a-9780-bf3748340381 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:30:11.512757 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2ea9d442-d108-4d7a-9780-bf3748340381 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] [instance: 96e1c662-e82a-421f-90ae-3388aa87cc4b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:30:11.519819 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2ea9d442-d108-4d7a-9780-bf3748340381 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:11.520302 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2ea9d442-d108-4d7a-9780-bf3748340381 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:11.521060 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2ea9d442-d108-4d7a-9780-bf3748340381 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:11.521489 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2ea9d442-d108-4d7a-9780-bf3748340381 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:11.560834 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2ea9d442-d108-4d7a-9780-bf3748340381 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:11.561262 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2ea9d442-d108-4d7a-9780-bf3748340381 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:11.561962 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-2ea9d442-d108-4d7a-9780-bf3748340381 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lazy-loading 'fault' on Instance uuid 96e1c662-e82a-421f-90ae-3388aa87cc4b {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:30:11.562521 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-71f8d632-bcab-4948-b943-a59596f04186 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-244961288", "imageRef": "800c492c-ff69-4735-b2c9-a2dcaa20aa8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ace36e5-8f62-484d-869a-4e76e67d3437"}], "security_groups": [{"name": "tempest-securitygroup--718715736"}], "key_name": "tempest-keypair-265059586", "user_data": "}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:30:11.605134 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2ea9d442-d108-4d7a-9780-bf3748340381 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101123f181a2446c84ddef2e98ace2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348519643baf4649be43dd14d4cd7cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:30:11.613359 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2ea9d442-d108-4d7a-9780-bf3748340381 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] 10.222.0.88 "GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b" status: 200 len: 1305 microversion: 2.1 time: 0.104980 May 17 17:30:11.613912 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 446/841] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:30:11 2022] GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b => generated 1305 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:30:11.666406 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.network.neutron [None req-71f8d632-bcab-4948-b943-a59596f04186 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] validate_networks() for [('1ace36e5-8f62-484d-869a-4e76e67d3437', None, None, None, None, None)] {{(pid=117611) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:30:12.029860 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-71f8d632-bcab-4948-b943-a59596f04186 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Flavor limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:30:12.030419 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-71f8d632-bcab-4948-b943-a59596f04186 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Image limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:30:12.030851 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-71f8d632-bcab-4948-b943-a59596f04186 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Flavor pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:30:12.031250 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-71f8d632-bcab-4948-b943-a59596f04186 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Image pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:30:12.031683 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-71f8d632-bcab-4948-b943-a59596f04186 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:30:12.041024 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-71f8d632-bcab-4948-b943-a59596f04186 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:12.041468 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-71f8d632-bcab-4948-b943-a59596f04186 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:12.042257 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-71f8d632-bcab-4948-b943-a59596f04186 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:12.042686 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-71f8d632-bcab-4948-b943-a59596f04186 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:12.058486 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-71f8d632-bcab-4948-b943-a59596f04186 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Getting quotas for project ed4b8b6a551347b6a920e4cfb59b9480. Resources: {'cores', 'ram', 'instances'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:30:12.062837 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-71f8d632-bcab-4948-b943-a59596f04186 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Getting quotas for user 7b22bf1b41774f64b7a380d86ef3f72e and project ed4b8b6a551347b6a920e4cfb59b9480. Resources: {'cores', 'ram', 'instances'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:30:12.073426 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-71f8d632-bcab-4948-b943-a59596f04186 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Going to run 1 instances... {{(pid=117611) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:30:12.076391 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-71f8d632-bcab-4948-b943-a59596f04186 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ecb716a9-d5f9-485a-85ce-4e9eb0e8292e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='800c492c-ff69-4735-b2c9-a2dcaa20aa8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:30:12.220675 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-71f8d632-bcab-4948-b943-a59596f04186 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.663559 May 17 17:30:12.228957 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 396/842] 10.222.0.88 () {60 vars in 1146 bytes} [Tue May 17 17:30:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 17 17:30:12.230953 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7e92ddbd-4ed9-441f-9da9-1ee46e72e8c8 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:30:12.231587 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-7e92ddbd-4ed9-441f-9da9-1ee46e72e8c8 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ecb716a9-d5f9-485a-85ce-4e9eb0e8292e] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:30:12.287298 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7e92ddbd-4ed9-441f-9da9-1ee46e72e8c8 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:30:12.293948 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7e92ddbd-4ed9-441f-9da9-1ee46e72e8c8 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e" status: 200 len: 1240 microversion: 2.1 time: 0.066743 May 17 17:30:12.295232 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 447/843] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:30:12 2022] GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:30:12.630160 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8e511f54-3087-4b9c-9429-0b88f58ec602 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:30:12.630777 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8e511f54-3087-4b9c-9429-0b88f58ec602 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] [instance: 96e1c662-e82a-421f-90ae-3388aa87cc4b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:30:12.637435 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8e511f54-3087-4b9c-9429-0b88f58ec602 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:12.637890 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8e511f54-3087-4b9c-9429-0b88f58ec602 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:12.639216 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8e511f54-3087-4b9c-9429-0b88f58ec602 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:12.639840 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8e511f54-3087-4b9c-9429-0b88f58ec602 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:12.653221 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-8e511f54-3087-4b9c-9429-0b88f58ec602 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] HTTP exception thrown: Instance 96e1c662-e82a-421f-90ae-3388aa87cc4b could not be found. May 17 17:30:12.654832 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8e511f54-3087-4b9c-9429-0b88f58ec602 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Request method failure captured: May 17 17:30:12.654832 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b HTTP/1.1 May 17 17:30:12.654832 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:30:12.654832 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:30:12.654832 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:30:12.654832 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:30:12.654832 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:30:12.654832 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:30:12.654832 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:30:12.654832 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:30:12.654832 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9uRRUTQjKwXzTODCnZVa6SCnGA8fQmn964_wXTPXn-6X4OWFAmURju67GWIoINdnbFLeSfXc543r0uzipmq_ANr75IcK0-mHy_NwiS2ikK59eO2gtSoOF8TWYWgjCAkX1nxneBumvtHtlqU_Ury265tJ_eeNg-1-w-pRtMs7YmhQRc May 17 17:30:12.654832 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:30:12.654832 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:30:12.654832 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:30:12.654832 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:30:12.654832 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:30:12.654832 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:30:12.654832 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: 348519643baf4649be43dd14d4cd7cc2 May 17 17:30:12.654832 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-VolumesNegativeTest-144384468 May 17 17:30:12.654832 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:30:12.654832 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:30:12.656571 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/348519643baf4649be43dd14d4cd7cc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/348519643baf4649be43dd14d4cd7cc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/348519643baf4649be43dd14d4cd7cc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_348519643baf4649be43dd14d4cd7cc2", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:30:12.656571 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-VolumesNegativeTest-144384468 May 17 17:30:12.656571 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: 348519643baf4649be43dd14d4cd7cc2 May 17 17:30:12.656571 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-VolumesNegativeTest-144384468 May 17 17:30:12.656571 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-VolumesNegativeTest-144384468-project May 17 17:30:12.656571 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:30:12.656571 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:30:12.656571 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 101123f181a2446c84ddef2e98ace2e3 May 17 17:30:12.656571 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-VolumesNegativeTest-144384468-project May 17 17:30:12.656571 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:30:12.656571 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Instance 96e1c662-e82a-421f-90ae-3388aa87cc4b could not be found. May 17 17:30:12.656571 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': '96e1c662-e82a-421f-90ae-3388aa87cc4b'} May 17 17:30:12.657641 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:30:12.657641 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:30:12.657641 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:30:12.657641 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:30:12.657641 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:30:12.657641 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:30:12.657641 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:30:12.657641 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:30:12.657641 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:30:12.657641 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:30:12.657641 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96e1c662-e82a-421f-90ae-3388aa87cc4b could not be found. May 17 17:30:12.657641 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:30:12.657641 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:30:12.657641 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:30:12.657641 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:30:12.657641 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:30:12.657641 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:30:12.657641 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:30:12.657641 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:30:12.657641 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:30:12.659234 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:30:12.659234 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:30:12.659234 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:30:12.659234 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:30:12.659234 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:30:12.659234 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:30:12.659234 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:30:12.659234 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96e1c662-e82a-421f-90ae-3388aa87cc4b could not be found. May 17 17:30:12.659234 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:30:12.659234 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:30:12.659234 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:30:12.659234 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:30:12.659234 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:30:12.659234 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:30:12.659234 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:30:12.659234 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:30:12.659234 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96e1c662-e82a-421f-90ae-3388aa87cc4b could not be found. May 17 17:30:12.659234 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:30:12.660675 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8e511f54-3087-4b9c-9429-0b88f58ec602 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] Returning 404 to user: Instance 96e1c662-e82a-421f-90ae-3388aa87cc4b could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:30:12.660675 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8e511f54-3087-4b9c-9429-0b88f58ec602 tempest-VolumesNegativeTest-144384468 tempest-VolumesNegativeTest-144384468-project] 10.222.0.88 "GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b" status: 404 len: 111 microversion: 2.1 time: 0.029936 May 17 17:30:12.660675 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 397/844] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:30:12 2022] GET /compute/v2.1/servers/96e1c662-e82a-421f-90ae-3388aa87cc4b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 17:30:13.312521 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b965658f-bd0f-4987-bd0f-36388653e2b6 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:30:13.313144 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b965658f-bd0f-4987-bd0f-36388653e2b6 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ecb716a9-d5f9-485a-85ce-4e9eb0e8292e] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:30:13.319726 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b965658f-bd0f-4987-bd0f-36388653e2b6 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:13.320182 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b965658f-bd0f-4987-bd0f-36388653e2b6 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:13.320961 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b965658f-bd0f-4987-bd0f-36388653e2b6 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:13.321419 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b965658f-bd0f-4987-bd0f-36388653e2b6 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:13.381117 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b965658f-bd0f-4987-bd0f-36388653e2b6 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:30:13.389203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b965658f-bd0f-4987-bd0f-36388653e2b6 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e" status: 200 len: 1244 microversion: 2.1 time: 0.081080 May 17 17:30:13.389774 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 448/845] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:30:13 2022] GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:30:14.405750 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6ff2812a-aa5a-4da3-8ed4-ee5e6a97cdc7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:30:14.406300 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6ff2812a-aa5a-4da3-8ed4-ee5e6a97cdc7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ecb716a9-d5f9-485a-85ce-4e9eb0e8292e] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:30:14.413301 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6ff2812a-aa5a-4da3-8ed4-ee5e6a97cdc7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:14.413769 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6ff2812a-aa5a-4da3-8ed4-ee5e6a97cdc7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:14.414540 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6ff2812a-aa5a-4da3-8ed4-ee5e6a97cdc7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:14.414976 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6ff2812a-aa5a-4da3-8ed4-ee5e6a97cdc7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:14.475694 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6ff2812a-aa5a-4da3-8ed4-ee5e6a97cdc7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:30:14.482911 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6ff2812a-aa5a-4da3-8ed4-ee5e6a97cdc7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e" status: 200 len: 1310 microversion: 2.1 time: 0.081128 May 17 17:30:14.483489 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 398/846] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:30:14 2022] GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e => generated 1310 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:30:15.500287 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2c2648ec-0217-46eb-8317-0a957eb3243b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:30:15.501587 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2c2648ec-0217-46eb-8317-0a957eb3243b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ecb716a9-d5f9-485a-85ce-4e9eb0e8292e] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:30:15.509022 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2c2648ec-0217-46eb-8317-0a957eb3243b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:15.509477 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2c2648ec-0217-46eb-8317-0a957eb3243b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:15.510241 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2c2648ec-0217-46eb-8317-0a957eb3243b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:15.510870 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2c2648ec-0217-46eb-8317-0a957eb3243b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:15.655327 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2c2648ec-0217-46eb-8317-0a957eb3243b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:30:15.663239 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2c2648ec-0217-46eb-8317-0a957eb3243b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e" status: 200 len: 1365 microversion: 2.1 time: 0.167102 May 17 17:30:15.679343 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 449/847] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:30:15 2022] GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:30:16.176972 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-5a96bd4e-0ff8-4de5-acc6-a1a231f40794 req-55d8e910-343d-4017-94ee-0f01b7581ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecb716a9-d5f9-485a-85ce-4e9eb0e8292e", "tag": "8015fb4d-c237-46d0-9ede-642e66bec592"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:30:16.188931 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-5a96bd4e-0ff8-4de5-acc6-a1a231f40794 req-55d8e910-343d-4017-94ee-0f01b7581ee2 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:16.189275 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-5a96bd4e-0ff8-4de5-acc6-a1a231f40794 req-55d8e910-343d-4017-94ee-0f01b7581ee2 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:16.214333 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-5a96bd4e-0ff8-4de5-acc6-a1a231f40794 req-55d8e910-343d-4017-94ee-0f01b7581ee2 service nova] Creating event network-changed:8015fb4d-c237-46d0-9ede-642e66bec592 for instance ecb716a9-d5f9-485a-85ce-4e9eb0e8292e on hv-cinder-84214 May 17 17:30:16.222234 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-5a96bd4e-0ff8-4de5-acc6-a1a231f40794 req-55d8e910-343d-4017-94ee-0f01b7581ee2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049361 May 17 17:30:16.223120 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 399/848] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:30:16.680903 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3e3c23b2-fae3-4807-8c23-abc130d2f1ac tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:30:16.681754 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3e3c23b2-fae3-4807-8c23-abc130d2f1ac tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ecb716a9-d5f9-485a-85ce-4e9eb0e8292e] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:30:16.689170 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3e3c23b2-fae3-4807-8c23-abc130d2f1ac tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:16.689623 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3e3c23b2-fae3-4807-8c23-abc130d2f1ac tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:16.690452 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3e3c23b2-fae3-4807-8c23-abc130d2f1ac tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:16.690870 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3e3c23b2-fae3-4807-8c23-abc130d2f1ac tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:16.839442 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-3e3c23b2-fae3-4807-8c23-abc130d2f1ac tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:30:16.848439 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3e3c23b2-fae3-4807-8c23-abc130d2f1ac tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e" status: 200 len: 1365 microversion: 2.1 time: 0.170776 May 17 17:30:16.849681 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 450/849] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:30:16 2022] GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:30:17.865643 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ab9950d3-6b73-4963-8f53-58a469953aa3 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:30:17.866341 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ab9950d3-6b73-4963-8f53-58a469953aa3 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ecb716a9-d5f9-485a-85ce-4e9eb0e8292e] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:30:17.873087 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ab9950d3-6b73-4963-8f53-58a469953aa3 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:17.873555 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ab9950d3-6b73-4963-8f53-58a469953aa3 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:17.874370 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ab9950d3-6b73-4963-8f53-58a469953aa3 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:17.874753 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ab9950d3-6b73-4963-8f53-58a469953aa3 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:18.000956 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ab9950d3-6b73-4963-8f53-58a469953aa3 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:30:18.008188 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ab9950d3-6b73-4963-8f53-58a469953aa3 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e" status: 200 len: 1365 microversion: 2.1 time: 0.147201 May 17 17:30:18.008741 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 400/850] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:30:17 2022] GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:30:19.025946 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4dc61edb-40ee-403e-9a67-d6f6633725e3 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:30:19.026552 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4dc61edb-40ee-403e-9a67-d6f6633725e3 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ecb716a9-d5f9-485a-85ce-4e9eb0e8292e] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:30:19.032759 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4dc61edb-40ee-403e-9a67-d6f6633725e3 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:19.033204 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4dc61edb-40ee-403e-9a67-d6f6633725e3 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:19.033964 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4dc61edb-40ee-403e-9a67-d6f6633725e3 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:19.034396 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4dc61edb-40ee-403e-9a67-d6f6633725e3 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:19.186305 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4dc61edb-40ee-403e-9a67-d6f6633725e3 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:30:19.194356 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4dc61edb-40ee-403e-9a67-d6f6633725e3 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e" status: 200 len: 1365 microversion: 2.1 time: 0.172295 May 17 17:30:19.196089 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 451/851] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:30:19 2022] GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:30:20.211034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3009ef46-08dc-404a-9268-580197fcfc94 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:30:20.211756 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3009ef46-08dc-404a-9268-580197fcfc94 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ecb716a9-d5f9-485a-85ce-4e9eb0e8292e] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:30:20.218736 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3009ef46-08dc-404a-9268-580197fcfc94 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:20.219217 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3009ef46-08dc-404a-9268-580197fcfc94 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:20.220045 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3009ef46-08dc-404a-9268-580197fcfc94 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:20.220481 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3009ef46-08dc-404a-9268-580197fcfc94 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:20.358112 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3009ef46-08dc-404a-9268-580197fcfc94 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:30:20.366083 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3009ef46-08dc-404a-9268-580197fcfc94 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e" status: 200 len: 1365 microversion: 2.1 time: 0.158751 May 17 17:30:20.366743 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 401/852] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:30:20 2022] GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:30:21.384301 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-809073b3-1d5f-4602-a370-60b2ba0f5c8c tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:30:21.384913 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-809073b3-1d5f-4602-a370-60b2ba0f5c8c tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ecb716a9-d5f9-485a-85ce-4e9eb0e8292e] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:30:21.392493 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-809073b3-1d5f-4602-a370-60b2ba0f5c8c tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:21.392937 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-809073b3-1d5f-4602-a370-60b2ba0f5c8c tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:21.393879 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-809073b3-1d5f-4602-a370-60b2ba0f5c8c tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:21.396112 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-809073b3-1d5f-4602-a370-60b2ba0f5c8c tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:21.525308 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-809073b3-1d5f-4602-a370-60b2ba0f5c8c tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:30:21.533062 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-809073b3-1d5f-4602-a370-60b2ba0f5c8c tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e" status: 200 len: 1365 microversion: 2.1 time: 0.153267 May 17 17:30:21.533615 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 452/853] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:30:21 2022] GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:30:21.916220 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-c9eaef8d-70d5-4a74-93b5-c183f2137f45 req-dc7010bf-d077-487c-a5ee-3953580d3880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecb716a9-d5f9-485a-85ce-4e9eb0e8292e", "name": "network-vif-plugged", "status": "completed", "tag": "8015fb4d-c237-46d0-9ede-642e66bec592"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:30:21.924718 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-c9eaef8d-70d5-4a74-93b5-c183f2137f45 req-dc7010bf-d077-487c-a5ee-3953580d3880 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:21.925155 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-c9eaef8d-70d5-4a74-93b5-c183f2137f45 req-dc7010bf-d077-487c-a5ee-3953580d3880 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:21.936128 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-c9eaef8d-70d5-4a74-93b5-c183f2137f45 req-dc7010bf-d077-487c-a5ee-3953580d3880 service nova] Creating event network-vif-plugged:8015fb4d-c237-46d0-9ede-642e66bec592 for instance ecb716a9-d5f9-485a-85ce-4e9eb0e8292e on hv-cinder-84214 May 17 17:30:21.940943 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-c9eaef8d-70d5-4a74-93b5-c183f2137f45 req-dc7010bf-d077-487c-a5ee-3953580d3880 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028556 May 17 17:30:21.941564 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 402/854] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:30:22.549913 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8ba8ba91-05c7-4315-bef5-251816785d7d tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:30:22.550457 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8ba8ba91-05c7-4315-bef5-251816785d7d tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ecb716a9-d5f9-485a-85ce-4e9eb0e8292e] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:30:22.556775 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8ba8ba91-05c7-4315-bef5-251816785d7d tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:22.557227 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8ba8ba91-05c7-4315-bef5-251816785d7d tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:22.558012 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8ba8ba91-05c7-4315-bef5-251816785d7d tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:22.558429 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8ba8ba91-05c7-4315-bef5-251816785d7d tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:22.687468 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8ba8ba91-05c7-4315-bef5-251816785d7d tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:30:22.694561 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8ba8ba91-05c7-4315-bef5-251816785d7d tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e" status: 200 len: 1365 microversion: 2.1 time: 0.148569 May 17 17:30:22.695114 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 453/855] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:30:22 2022] GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:30:23.712456 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1656ed22-fc44-4fc1-9189-76dd4d394f88 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:30:23.713174 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1656ed22-fc44-4fc1-9189-76dd4d394f88 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ecb716a9-d5f9-485a-85ce-4e9eb0e8292e] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:30:23.719826 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1656ed22-fc44-4fc1-9189-76dd4d394f88 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:23.720268 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1656ed22-fc44-4fc1-9189-76dd4d394f88 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:23.721017 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1656ed22-fc44-4fc1-9189-76dd4d394f88 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:23.721449 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1656ed22-fc44-4fc1-9189-76dd4d394f88 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:23.847630 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-1656ed22-fc44-4fc1-9189-76dd4d394f88 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:30:23.855241 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1656ed22-fc44-4fc1-9189-76dd4d394f88 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e" status: 200 len: 1365 microversion: 2.1 time: 0.147027 May 17 17:30:23.855840 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 403/856] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:30:23 2022] GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:30:24.608092 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 17:30:24.608650 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Tue May 17 17:30:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 17:30:24.872641 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-611838ef-4cb3-4035-84ff-8cdb6fea3f34 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:30:24.873176 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-611838ef-4cb3-4035-84ff-8cdb6fea3f34 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ecb716a9-d5f9-485a-85ce-4e9eb0e8292e] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:30:24.880666 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-611838ef-4cb3-4035-84ff-8cdb6fea3f34 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:24.881143 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-611838ef-4cb3-4035-84ff-8cdb6fea3f34 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:24.881923 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-611838ef-4cb3-4035-84ff-8cdb6fea3f34 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:24.882360 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-611838ef-4cb3-4035-84ff-8cdb6fea3f34 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:25.007116 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-611838ef-4cb3-4035-84ff-8cdb6fea3f34 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:30:25.014579 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-611838ef-4cb3-4035-84ff-8cdb6fea3f34 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e" status: 200 len: 1555 microversion: 2.1 time: 0.146445 May 17 17:30:25.015125 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 454/857] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:30:24 2022] GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:30:25.030419 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-83cd673d-1999-4b90-8ff3-f7184e4318d4 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:30:25.030927 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-83cd673d-1999-4b90-8ff3-f7184e4318d4 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ecb716a9-d5f9-485a-85ce-4e9eb0e8292e] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:30:25.037491 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-83cd673d-1999-4b90-8ff3-f7184e4318d4 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:25.037935 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-83cd673d-1999-4b90-8ff3-f7184e4318d4 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:25.038691 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-83cd673d-1999-4b90-8ff3-f7184e4318d4 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:25.039121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-83cd673d-1999-4b90-8ff3-f7184e4318d4 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:25.117602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-83cd673d-1999-4b90-8ff3-f7184e4318d4 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090876 May 17 17:30:25.118183 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 404/858] 10.222.0.88 () {58 vars in 1274 bytes} [Tue May 17 17:30:25 2022] GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:30:26.084707 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-c1540856-a677-4cff-aa05-d9ccb2185229 req-e52fe3eb-8155-4e90-ad7b-9c16dcc15f36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecb716a9-d5f9-485a-85ce-4e9eb0e8292e", "tag": "8015fb4d-c237-46d0-9ede-642e66bec592"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:30:26.093104 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-c1540856-a677-4cff-aa05-d9ccb2185229 req-e52fe3eb-8155-4e90-ad7b-9c16dcc15f36 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:30:26.093550 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-c1540856-a677-4cff-aa05-d9ccb2185229 req-e52fe3eb-8155-4e90-ad7b-9c16dcc15f36 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:30:26.104358 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-c1540856-a677-4cff-aa05-d9ccb2185229 req-e52fe3eb-8155-4e90-ad7b-9c16dcc15f36 service nova] Creating event network-changed:8015fb4d-c237-46d0-9ede-642e66bec592 for instance ecb716a9-d5f9-485a-85ce-4e9eb0e8292e on hv-cinder-84214 May 17 17:30:26.109331 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-c1540856-a677-4cff-aa05-d9ccb2185229 req-e52fe3eb-8155-4e90-ad7b-9c16dcc15f36 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028212 May 17 17:30:26.109913 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 455/859] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:31:06.052145 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1bf8b89a-a856-40a7-983b-57c1f7f9eb3b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1641244553", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-647335372", "security_groups": [{"name": "tempest-secgroup-smoke-42262070"}], "block_device_mapping_v2": [{"uuid": "369029d3-ce30-4911-abf1-89d1e8568682", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fcf7be69-9ae2-4258-af0f-0fdac2597600"}]}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:31:06.160517 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.network.neutron [None req-1bf8b89a-a856-40a7-983b-57c1f7f9eb3b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] validate_networks() for [('fcf7be69-9ae2-4258-af0f-0fdac2597600', None, None, None, None, None)] {{(pid=117611) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:31:06.511405 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-1bf8b89a-a856-40a7-983b-57c1f7f9eb3b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Flavor limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:31:06.511886 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-1bf8b89a-a856-40a7-983b-57c1f7f9eb3b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Image limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:31:06.512358 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-1bf8b89a-a856-40a7-983b-57c1f7f9eb3b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Flavor pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:31:06.512879 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-1bf8b89a-a856-40a7-983b-57c1f7f9eb3b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Image pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:31:06.513324 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-1bf8b89a-a856-40a7-983b-57c1f7f9eb3b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:31:06.521874 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1bf8b89a-a856-40a7-983b-57c1f7f9eb3b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:06.522269 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1bf8b89a-a856-40a7-983b-57c1f7f9eb3b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:06.523102 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1bf8b89a-a856-40a7-983b-57c1f7f9eb3b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:06.523558 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1bf8b89a-a856-40a7-983b-57c1f7f9eb3b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:06.540045 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-1bf8b89a-a856-40a7-983b-57c1f7f9eb3b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Getting quotas for project 3f5eec12182649ba98446cf774faf873. Resources: {'cores', 'ram', 'instances'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:31:06.544633 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-1bf8b89a-a856-40a7-983b-57c1f7f9eb3b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Getting quotas for user 6cbe2975d6d24b4280a28056afaeb873 and project 3f5eec12182649ba98446cf774faf873. Resources: {'cores', 'ram', 'instances'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:31:06.598535 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1bf8b89a-a856-40a7-983b-57c1f7f9eb3b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Going to run 1 instances... {{(pid=117611) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:31:06.600612 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1bf8b89a-a856-40a7-983b-57c1f7f9eb3b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 350d6927-4954-47cc-9754-2f9ad827e2fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='369029d3-ce30-4911-abf1-89d1e8568682',volume_size=None,volume_type=None)] {{(pid=117611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:31:07.028980 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1bf8b89a-a856-40a7-983b-57c1f7f9eb3b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.981231 May 17 17:31:07.029615 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 405/860] 10.222.0.88 () {60 vars in 1146 bytes} [Tue May 17 17:31:06 2022] POST /compute/v2.1/servers => generated 404 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:31:07.041170 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3ee42526-69ae-4efc-8075-9b52c368357c tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:07.041873 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3ee42526-69ae-4efc-8075-9b52c368357c tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 350d6927-4954-47cc-9754-2f9ad827e2fa] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:07.097694 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-3ee42526-69ae-4efc-8075-9b52c368357c tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:07.104443 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3ee42526-69ae-4efc-8075-9b52c368357c tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa" status: 200 len: 1094 microversion: 2.1 time: 0.068481 May 17 17:31:07.105537 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 456/861] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:07 2022] GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:08.122404 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c7d0eff5-780d-4533-9a55-055952220b66 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:08.123145 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c7d0eff5-780d-4533-9a55-055952220b66 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 350d6927-4954-47cc-9754-2f9ad827e2fa] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:08.129195 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c7d0eff5-780d-4533-9a55-055952220b66 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:08.129639 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c7d0eff5-780d-4533-9a55-055952220b66 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:08.130401 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c7d0eff5-780d-4533-9a55-055952220b66 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:08.130833 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c7d0eff5-780d-4533-9a55-055952220b66 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:08.191273 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c7d0eff5-780d-4533-9a55-055952220b66 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:08.198548 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c7d0eff5-780d-4533-9a55-055952220b66 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa" status: 200 len: 1144 microversion: 2.1 time: 0.080863 May 17 17:31:08.199187 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 406/862] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:08 2022] GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:09.213847 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-44132b95-9979-4b76-aa14-ebf155e10458 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:09.214462 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-44132b95-9979-4b76-aa14-ebf155e10458 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 350d6927-4954-47cc-9754-2f9ad827e2fa] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:09.225841 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-44132b95-9979-4b76-aa14-ebf155e10458 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:09.225841 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-44132b95-9979-4b76-aa14-ebf155e10458 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:09.225841 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-44132b95-9979-4b76-aa14-ebf155e10458 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:09.225841 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-44132b95-9979-4b76-aa14-ebf155e10458 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:09.284982 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-44132b95-9979-4b76-aa14-ebf155e10458 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:09.293192 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-44132b95-9979-4b76-aa14-ebf155e10458 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa" status: 200 len: 1210 microversion: 2.1 time: 0.083052 May 17 17:31:09.293876 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 457/863] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:09 2022] GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa => generated 1210 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:31:09.841604 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7b2da739-49f6-4635-ba4d-d6bf2e4ba6c3 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:09.842229 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-7b2da739-49f6-4635-ba4d-d6bf2e4ba6c3 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ecb716a9-d5f9-485a-85ce-4e9eb0e8292e] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:09.849228 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7b2da739-49f6-4635-ba4d-d6bf2e4ba6c3 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:09.851457 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7b2da739-49f6-4635-ba4d-d6bf2e4ba6c3 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:09.851457 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7b2da739-49f6-4635-ba4d-d6bf2e4ba6c3 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:09.851457 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7b2da739-49f6-4635-ba4d-d6bf2e4ba6c3 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:09.878050 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-7b2da739-49f6-4635-ba4d-d6bf2e4ba6c3 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e/ips" status: 200 len: 150 microversion: 2.1 time: 0.040747 May 17 17:31:09.878686 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 407/864] 10.222.0.88 () {58 vars in 1247 bytes} [Tue May 17 17:31:09 2022] GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:31:09.889322 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0eabc2ca-c39c-4077-8407-ec432492e693 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54f1bbe6-8792-4536-ba9e-f2b484047f3e"}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:31:09.890252 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0eabc2ca-c39c-4077-8407-ec432492e693 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ecb716a9-d5f9-485a-85ce-4e9eb0e8292e] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:09.896444 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0eabc2ca-c39c-4077-8407-ec432492e693 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:09.897086 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0eabc2ca-c39c-4077-8407-ec432492e693 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:09.898047 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0eabc2ca-c39c-4077-8407-ec432492e693 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:09.898655 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0eabc2ca-c39c-4077-8407-ec432492e693 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:10.003278 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-0eabc2ca-c39c-4077-8407-ec432492e693 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] HTTP exception thrown: Invalid volume: volume 54f1bbe6-8792-4536-ba9e-f2b484047f3e is already attached to instances: ace49a2e-2ed3-43e0-a7c4-e275251ff690 May 17 17:31:10.005006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0eabc2ca-c39c-4077-8407-ec432492e693 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Request method failure captured: May 17 17:31:10.005006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: request: POST /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e/os-volume_attachments HTTP/1.1 May 17 17:31:10.005006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 17 17:31:10.005006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 17 17:31:10.005006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Connection: close May 17 17:31:10.005006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Length: 74 May 17 17:31:10.005006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 17 17:31:10.005006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.88 May 17 17:31:10.005006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 17 17:31:10.005006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 17 17:31:10.005006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABig9tWg17ELpg_TTkWzbFxHdaAAQsss46MNpXjEEnfH7yXijN80XDWmxF0PUmXoUksbJKowpEVVnYtBVvoWuiL6GXCGYlSppsHPRNYd8MeFV0B2bmGGuVwLt685v1qI8gbaO7aXhyrZ0FembuKv9KvgsXW4ySi9m_Wz_eukMKqtMUcZBY May 17 17:31:10.005006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 17 17:31:10.005006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 17 17:31:10.005006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 17 17:31:10.005006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 17 17:31:10.005006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 17 17:31:10.005006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 17 17:31:10.005006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Id: ed4b8b6a551347b6a920e4cfb59b9480 May 17 17:31:10.005006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:31:10.005006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Role: reader,member May 17 17:31:10.005006 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Roles: reader,member May 17 17:31:10.007314 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ed4b8b6a551347b6a920e4cfb59b9480", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:31:10.007314 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:31:10.007314 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: ed4b8b6a551347b6a920e4cfb59b9480 May 17 17:31:10.007314 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:31:10.007314 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeNegativeTest-1113418987-project May 17 17:31:10.007314 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 17 17:31:10.007314 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 17 17:31:10.007314 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Id: 7b22bf1b41774f64b7a380d86ef3f72e May 17 17:31:10.007314 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeNegativeTest-1113418987-project May 17 17:31:10.007314 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: May 17 17:31:10.007314 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {"volumeAttachment": {"volumeId": "54f1bbe6-8792-4536-ba9e-f2b484047f3e"}} May 17 17:31:10.007314 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: method: > May 17 17:31:10.008349 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: exception: Invalid volume: volume 54f1bbe6-8792-4536-ba9e-f2b484047f3e is already attached to instances: ace49a2e-2ed3-43e0-a7c4-e275251ff690 May 17 17:31:10.008349 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: action_args: {'server_id': 'ecb716a9-d5f9-485a-85ce-4e9eb0e8292e', 'body': {'volumeAttachment': {'volumeId': '54f1bbe6-8792-4536-ba9e-f2b484047f3e'}}} May 17 17:31:10.008349 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:31:10.008349 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:31:10.008349 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 17 17:31:10.008349 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 17 17:31:10.008349 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 17 17:31:10.008349 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 17 17:31:10.008349 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 17 17:31:10.008349 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 17 17:31:10.008349 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 17 17:31:10.008349 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 17 17:31:10.008349 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 17 17:31:10.008349 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 17 17:31:10.008349 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 54f1bbe6-8792-4536-ba9e-f2b484047f3e is already attached to instances: ace49a2e-2ed3-43e0-a7c4-e275251ff690 May 17 17:31:10.008349 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:31:10.008349 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:31:10.008349 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:31:10.008349 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:31:10.009872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:31:10.009872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:31:10.009872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:31:10.009872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:31:10.009872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:31:10.009872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:31:10.009872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 17:31:10.009872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 17:31:10.009872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 17:31:10.009872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 17:31:10.009872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 17:31:10.009872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 17:31:10.009872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 17 17:31:10.009872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 17 17:31:10.009872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 54f1bbe6-8792-4536-ba9e-f2b484047f3e is already attached to instances: ace49a2e-2ed3-43e0-a7c4-e275251ff690 May 17 17:31:10.009872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:31:10.009872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:31:10.009872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:31:10.009872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:31:10.009872 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:31:10.011461 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:31:10.011461 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:31:10.011461 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:31:10.011461 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 54f1bbe6-8792-4536-ba9e-f2b484047f3e is already attached to instances: ace49a2e-2ed3-43e0-a7c4-e275251ff690 May 17 17:31:10.011461 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:31:10.011461 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0eabc2ca-c39c-4077-8407-ec432492e693 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Returning 400 to user: Invalid volume: volume 54f1bbe6-8792-4536-ba9e-f2b484047f3e is already attached to instances: ace49a2e-2ed3-43e0-a7c4-e275251ff690 {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:31:10.012783 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0eabc2ca-c39c-4077-8407-ec432492e693 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "POST /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.127651 May 17 17:31:10.013333 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 458/865] 10.222.0.88 () {60 vars in 1322 bytes} [Tue May 17 17:31:09 2022] POST /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e/os-volume_attachments => generated 174 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 17:31:10.021463 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-81459233-9c28-49fd-a90c-123bdf6218fc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:10.021956 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-81459233-9c28-49fd-a90c-123bdf6218fc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ecb716a9-d5f9-485a-85ce-4e9eb0e8292e] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:10.028246 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-81459233-9c28-49fd-a90c-123bdf6218fc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:10.028695 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-81459233-9c28-49fd-a90c-123bdf6218fc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:10.029460 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-81459233-9c28-49fd-a90c-123bdf6218fc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:10.029889 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-81459233-9c28-49fd-a90c-123bdf6218fc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:10.055080 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-81459233-9c28-49fd-a90c-123bdf6218fc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ecb716a9-d5f9-485a-85ce-4e9eb0e8292e] Going to try to terminate instance {{(pid=117611) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:31:10.310657 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-040d02d2-1612-4448-a75b-3d2addd4d2c5 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:10.311256 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-040d02d2-1612-4448-a75b-3d2addd4d2c5 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 350d6927-4954-47cc-9754-2f9ad827e2fa] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:10.318466 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-040d02d2-1612-4448-a75b-3d2addd4d2c5 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:10.319013 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-040d02d2-1612-4448-a75b-3d2addd4d2c5 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:10.319922 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-040d02d2-1612-4448-a75b-3d2addd4d2c5 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:10.320417 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-040d02d2-1612-4448-a75b-3d2addd4d2c5 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:10.434419 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-81459233-9c28-49fd-a90c-123bdf6218fc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "DELETE /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e" status: 204 len: 0 microversion: 2.1 time: 0.416370 May 17 17:31:10.435030 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 408/866] 10.222.0.88 () {58 vars in 1238 bytes} [Tue May 17 17:31:10 2022] DELETE /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:31:10.443421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b1bdecae-ac93-482c-95f6-138c5da1d3d7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:10.445202 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b1bdecae-ac93-482c-95f6-138c5da1d3d7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ecb716a9-d5f9-485a-85ce-4e9eb0e8292e] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:10.456957 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b1bdecae-ac93-482c-95f6-138c5da1d3d7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:10.457407 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b1bdecae-ac93-482c-95f6-138c5da1d3d7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:10.458181 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b1bdecae-ac93-482c-95f6-138c5da1d3d7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:10.458791 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b1bdecae-ac93-482c-95f6-138c5da1d3d7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:10.476665 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-040d02d2-1612-4448-a75b-3d2addd4d2c5 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:10.484095 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-040d02d2-1612-4448-a75b-3d2addd4d2c5 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa" status: 200 len: 1264 microversion: 2.1 time: 0.177831 May 17 17:31:10.484665 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 459/867] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:10 2022] GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:31:10.599530 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b1bdecae-ac93-482c-95f6-138c5da1d3d7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:10.608989 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b1bdecae-ac93-482c-95f6-138c5da1d3d7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e" status: 200 len: 1680 microversion: 2.1 time: 0.168208 May 17 17:31:10.608989 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 409/868] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:10 2022] GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:10.645177 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-05eadad6-7f81-4557-b1f8-c16a1a93d9ea req-755b6a0c-48e1-4b65-a47e-983a3e874d04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "350d6927-4954-47cc-9754-2f9ad827e2fa", "tag": "ee4b9620-180f-492b-accb-1763e0c6c58b"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:31:10.654036 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-05eadad6-7f81-4557-b1f8-c16a1a93d9ea req-755b6a0c-48e1-4b65-a47e-983a3e874d04 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:10.654466 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-05eadad6-7f81-4557-b1f8-c16a1a93d9ea req-755b6a0c-48e1-4b65-a47e-983a3e874d04 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:10.666726 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-05eadad6-7f81-4557-b1f8-c16a1a93d9ea req-755b6a0c-48e1-4b65-a47e-983a3e874d04 service nova] Creating event network-changed:ee4b9620-180f-492b-accb-1763e0c6c58b for instance 350d6927-4954-47cc-9754-2f9ad827e2fa on hv-cinder-84214 May 17 17:31:10.671990 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-05eadad6-7f81-4557-b1f8-c16a1a93d9ea req-755b6a0c-48e1-4b65-a47e-983a3e874d04 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030221 May 17 17:31:10.672655 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 460/869] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:31:11.501872 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-661c0a13-9a38-464e-bd3a-a07f4c7e0322 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:11.502465 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-661c0a13-9a38-464e-bd3a-a07f4c7e0322 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 350d6927-4954-47cc-9754-2f9ad827e2fa] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:11.508733 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-661c0a13-9a38-464e-bd3a-a07f4c7e0322 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:11.509176 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-661c0a13-9a38-464e-bd3a-a07f4c7e0322 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:11.509930 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-661c0a13-9a38-464e-bd3a-a07f4c7e0322 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:11.510361 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-661c0a13-9a38-464e-bd3a-a07f4c7e0322 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:11.627899 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2a8c939f-e942-47d9-935d-9c79137f0449 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:11.628836 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2a8c939f-e942-47d9-935d-9c79137f0449 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ecb716a9-d5f9-485a-85ce-4e9eb0e8292e] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:11.638867 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-661c0a13-9a38-464e-bd3a-a07f4c7e0322 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:11.642001 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2a8c939f-e942-47d9-935d-9c79137f0449 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:11.642470 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2a8c939f-e942-47d9-935d-9c79137f0449 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:11.643266 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2a8c939f-e942-47d9-935d-9c79137f0449 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:11.643755 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2a8c939f-e942-47d9-935d-9c79137f0449 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:11.645854 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-661c0a13-9a38-464e-bd3a-a07f4c7e0322 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa" status: 200 len: 1264 microversion: 2.1 time: 0.147688 May 17 17:31:11.651618 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 410/870] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:11 2022] GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:12.033011 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2a8c939f-e942-47d9-935d-9c79137f0449 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:12.040890 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2a8c939f-e942-47d9-935d-9c79137f0449 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e" status: 200 len: 1680 microversion: 2.1 time: 0.418826 May 17 17:31:12.041451 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 461/871] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:11 2022] GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e => generated 1680 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:31:12.662254 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ea030b7b-77e5-4200-bc33-badddd8499b6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:12.663110 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ea030b7b-77e5-4200-bc33-badddd8499b6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 350d6927-4954-47cc-9754-2f9ad827e2fa] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:12.670150 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ea030b7b-77e5-4200-bc33-badddd8499b6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:12.670622 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ea030b7b-77e5-4200-bc33-badddd8499b6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:12.671396 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ea030b7b-77e5-4200-bc33-badddd8499b6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:12.671865 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ea030b7b-77e5-4200-bc33-badddd8499b6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:12.883369 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ea030b7b-77e5-4200-bc33-badddd8499b6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:12.891364 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ea030b7b-77e5-4200-bc33-badddd8499b6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa" status: 200 len: 1264 microversion: 2.1 time: 0.232995 May 17 17:31:12.898369 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 411/872] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:12 2022] GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa => generated 1264 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:13.056477 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-c146c858-cd96-42c0-b960-fec6d26cf008 req-4bfe9638-6815-4a17-bb39-925e6b57789d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecb716a9-d5f9-485a-85ce-4e9eb0e8292e", "name": "network-vif-deleted", "tag": "8015fb4d-c237-46d0-9ede-642e66bec592"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:31:13.058362 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d61fa426-8322-4436-9b30-db2ff359cab2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:13.058983 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d61fa426-8322-4436-9b30-db2ff359cab2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ecb716a9-d5f9-485a-85ce-4e9eb0e8292e] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:13.065269 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d61fa426-8322-4436-9b30-db2ff359cab2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:13.066292 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d61fa426-8322-4436-9b30-db2ff359cab2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:13.066476 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d61fa426-8322-4436-9b30-db2ff359cab2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:13.067095 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d61fa426-8322-4436-9b30-db2ff359cab2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:13.069053 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-c146c858-cd96-42c0-b960-fec6d26cf008 req-4bfe9638-6815-4a17-bb39-925e6b57789d service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:13.069581 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-c146c858-cd96-42c0-b960-fec6d26cf008 req-4bfe9638-6815-4a17-bb39-925e6b57789d service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:13.084237 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-c146c858-cd96-42c0-b960-fec6d26cf008 req-4bfe9638-6815-4a17-bb39-925e6b57789d service nova] Creating event network-vif-deleted:8015fb4d-c237-46d0-9ede-642e66bec592 for instance ecb716a9-d5f9-485a-85ce-4e9eb0e8292e on hv-cinder-84214 May 17 17:31:13.090584 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-c146c858-cd96-42c0-b960-fec6d26cf008 req-4bfe9638-6815-4a17-bb39-925e6b57789d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038475 May 17 17:31:13.094262 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 462/873] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:31:13.141396 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d61fa426-8322-4436-9b30-db2ff359cab2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:13.150387 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d61fa426-8322-4436-9b30-db2ff359cab2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e" status: 200 len: 1613 microversion: 2.1 time: 0.096151 May 17 17:31:13.159689 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 412/874] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:13 2022] GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e => generated 1613 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:31:13.909201 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-74c0a04f-e9bd-4954-b1ed-f3fdb9be1801 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:13.909980 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-74c0a04f-e9bd-4954-b1ed-f3fdb9be1801 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 350d6927-4954-47cc-9754-2f9ad827e2fa] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:13.916629 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-74c0a04f-e9bd-4954-b1ed-f3fdb9be1801 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:13.917285 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-74c0a04f-e9bd-4954-b1ed-f3fdb9be1801 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:13.918206 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-74c0a04f-e9bd-4954-b1ed-f3fdb9be1801 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:13.918581 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-74c0a04f-e9bd-4954-b1ed-f3fdb9be1801 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:14.056272 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-74c0a04f-e9bd-4954-b1ed-f3fdb9be1801 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:14.064351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-74c0a04f-e9bd-4954-b1ed-f3fdb9be1801 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa" status: 200 len: 1264 microversion: 2.1 time: 0.159602 May 17 17:31:14.064910 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 463/875] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:13 2022] GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:14.168882 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7436646a-cb90-486c-aa66-dfffda159347 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:14.169522 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-7436646a-cb90-486c-aa66-dfffda159347 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ecb716a9-d5f9-485a-85ce-4e9eb0e8292e] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:14.175865 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7436646a-cb90-486c-aa66-dfffda159347 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:14.176320 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7436646a-cb90-486c-aa66-dfffda159347 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:14.177105 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7436646a-cb90-486c-aa66-dfffda159347 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:14.177551 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7436646a-cb90-486c-aa66-dfffda159347 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:14.190650 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-7436646a-cb90-486c-aa66-dfffda159347 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] HTTP exception thrown: Instance ecb716a9-d5f9-485a-85ce-4e9eb0e8292e could not be found. May 17 17:31:14.192287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7436646a-cb90-486c-aa66-dfffda159347 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Request method failure captured: May 17 17:31:14.192287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e HTTP/1.1 May 17 17:31:14.192287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:31:14.192287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:31:14.192287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:31:14.192287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:31:14.192287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:31:14.192287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:31:14.192287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:31:14.192287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:31:14.192287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9tWg17ELpg_TTkWzbFxHdaAAQsss46MNpXjEEnfH7yXijN80XDWmxF0PUmXoUksbJKowpEVVnYtBVvoWuiL6GXCGYlSppsHPRNYd8MeFV0B2bmGGuVwLt685v1qI8gbaO7aXhyrZ0FembuKv9KvgsXW4ySi9m_Wz_eukMKqtMUcZBY May 17 17:31:14.192287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:31:14.192287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:31:14.192287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:31:14.192287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:31:14.192287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:31:14.192287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:31:14.192287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: ed4b8b6a551347b6a920e4cfb59b9480 May 17 17:31:14.192287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:31:14.192287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:31:14.192287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:31:14.194007 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ed4b8b6a551347b6a920e4cfb59b9480", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:31:14.194007 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:31:14.194007 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: ed4b8b6a551347b6a920e4cfb59b9480 May 17 17:31:14.194007 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:31:14.194007 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-AttachVolumeNegativeTest-1113418987-project May 17 17:31:14.194007 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:31:14.194007 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:31:14.194007 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 7b22bf1b41774f64b7a380d86ef3f72e May 17 17:31:14.194007 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-AttachVolumeNegativeTest-1113418987-project May 17 17:31:14.194007 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:31:14.194007 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Instance ecb716a9-d5f9-485a-85ce-4e9eb0e8292e could not be found. May 17 17:31:14.194007 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': 'ecb716a9-d5f9-485a-85ce-4e9eb0e8292e'} May 17 17:31:14.194934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:31:14.194934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:31:14.194934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:31:14.194934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:31:14.194934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:31:14.194934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:31:14.194934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:31:14.194934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:31:14.194934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:31:14.194934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:31:14.194934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecb716a9-d5f9-485a-85ce-4e9eb0e8292e could not be found. May 17 17:31:14.194934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:31:14.194934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:31:14.194934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:31:14.194934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:31:14.194934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:31:14.194934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:31:14.194934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:31:14.194934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:31:14.194934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:31:14.196518 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:31:14.196518 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:31:14.196518 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:31:14.196518 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:31:14.196518 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:31:14.196518 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:31:14.196518 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:31:14.196518 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecb716a9-d5f9-485a-85ce-4e9eb0e8292e could not be found. May 17 17:31:14.196518 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:31:14.196518 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:31:14.196518 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:31:14.196518 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:31:14.196518 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:31:14.196518 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:31:14.196518 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:31:14.196518 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:31:14.196518 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecb716a9-d5f9-485a-85ce-4e9eb0e8292e could not be found. May 17 17:31:14.196518 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:31:14.197874 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7436646a-cb90-486c-aa66-dfffda159347 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Returning 404 to user: Instance ecb716a9-d5f9-485a-85ce-4e9eb0e8292e could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:31:14.197874 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-7436646a-cb90-486c-aa66-dfffda159347 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e" status: 404 len: 111 microversion: 2.1 time: 0.029441 May 17 17:31:14.197874 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 413/876] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:14 2022] GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:31:14.202335 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-74611926-60ed-4679-8c4e-e90fae77ccb3 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '.version_select at 0x7f73d4a27790>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:14.268076 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-74611926-60ed-4679-8c4e-e90fae77ccb3 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-265059586" status: 202 len: 0 microversion: 2.1 time: 0.069469 May 17 17:31:14.268555 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 464/877] 10.222.0.88 () {58 vars in 1217 bytes} [Tue May 17 17:31:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-265059586 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:31:15.034879 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-772d5c21-4c8e-4905-ae02-6c6c181b9a89 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:15.035369 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-772d5c21-4c8e-4905-ae02-6c6c181b9a89 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:15.041513 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-772d5c21-4c8e-4905-ae02-6c6c181b9a89 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:15.042051 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-772d5c21-4c8e-4905-ae02-6c6c181b9a89 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:15.043313 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-772d5c21-4c8e-4905-ae02-6c6c181b9a89 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:15.043773 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-772d5c21-4c8e-4905-ae02-6c6c181b9a89 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:15.081977 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7821fede-2e4e-43a0-86a0-4604c2f0c7f2 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:15.082779 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-7821fede-2e4e-43a0-86a0-4604c2f0c7f2 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 350d6927-4954-47cc-9754-2f9ad827e2fa] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:15.088568 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7821fede-2e4e-43a0-86a0-4604c2f0c7f2 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:15.089619 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7821fede-2e4e-43a0-86a0-4604c2f0c7f2 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:15.090692 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7821fede-2e4e-43a0-86a0-4604c2f0c7f2 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:15.091331 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7821fede-2e4e-43a0-86a0-4604c2f0c7f2 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:15.123736 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.objects.instance [None req-772d5c21-4c8e-4905-ae02-6c6c181b9a89 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lazy-loading 'services' on Instance uuid ace49a2e-2ed3-43e0-a7c4-e275251ff690 {{(pid=117611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:31:15.227175 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7821fede-2e4e-43a0-86a0-4604c2f0c7f2 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:15.234481 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7821fede-2e4e-43a0-86a0-4604c2f0c7f2 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa" status: 200 len: 1264 microversion: 2.1 time: 0.156812 May 17 17:31:15.235069 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 465/878] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:15 2022] GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:31:15.351620 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-772d5c21-4c8e-4905-ae02-6c6c181b9a89 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "DELETE /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690/os-volume_attachments/54f1bbe6-8792-4536-ba9e-f2b484047f3e" status: 202 len: 0 microversion: 2.1 time: 0.320401 May 17 17:31:15.352886 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 414/879] 10.222.0.88 () {58 vars in 1415 bytes} [Tue May 17 17:31:15 2022] DELETE /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690/os-volume_attachments/54f1bbe6-8792-4536-ba9e-f2b484047f3e => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:31:15.360498 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5a4fab43-26ff-4498-a1f3-4eb6b558b31e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:15.361445 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5a4fab43-26ff-4498-a1f3-4eb6b558b31e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:15.367839 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5a4fab43-26ff-4498-a1f3-4eb6b558b31e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:15.368517 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5a4fab43-26ff-4498-a1f3-4eb6b558b31e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:15.369291 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5a4fab43-26ff-4498-a1f3-4eb6b558b31e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:15.369720 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5a4fab43-26ff-4498-a1f3-4eb6b558b31e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:15.400228 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5a4fab43-26ff-4498-a1f3-4eb6b558b31e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043477 May 17 17:31:15.400755 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 466/880] 10.222.0.88 () {58 vars in 1301 bytes} [Tue May 17 17:31:15 2022] GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:31:16.251576 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-809d6d88-9f68-47b6-84ea-316f24870365 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:16.252198 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-809d6d88-9f68-47b6-84ea-316f24870365 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 350d6927-4954-47cc-9754-2f9ad827e2fa] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:16.258642 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-809d6d88-9f68-47b6-84ea-316f24870365 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:16.259085 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-809d6d88-9f68-47b6-84ea-316f24870365 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:16.259913 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-809d6d88-9f68-47b6-84ea-316f24870365 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:16.260347 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-809d6d88-9f68-47b6-84ea-316f24870365 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:16.391590 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-809d6d88-9f68-47b6-84ea-316f24870365 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:16.398761 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-809d6d88-9f68-47b6-84ea-316f24870365 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa" status: 200 len: 1264 microversion: 2.1 time: 0.151481 May 17 17:31:16.399326 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 415/881] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:16 2022] GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:16.412196 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f6d96756-c3a1-4af3-bcd5-8bc3c7b2b083 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:16.413367 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f6d96756-c3a1-4af3-bcd5-8bc3c7b2b083 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:16.420278 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f6d96756-c3a1-4af3-bcd5-8bc3c7b2b083 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:16.420722 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f6d96756-c3a1-4af3-bcd5-8bc3c7b2b083 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:16.421507 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f6d96756-c3a1-4af3-bcd5-8bc3c7b2b083 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:16.421924 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f6d96756-c3a1-4af3-bcd5-8bc3c7b2b083 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:16.449565 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f6d96756-c3a1-4af3-bcd5-8bc3c7b2b083 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041250 May 17 17:31:16.450093 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 467/882] 10.222.0.88 () {58 vars in 1301 bytes} [Tue May 17 17:31:16 2022] GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:31:17.416130 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-85df8d46-2878-4637-951a-ddfdb44a6ed3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:17.417287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-85df8d46-2878-4637-951a-ddfdb44a6ed3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 350d6927-4954-47cc-9754-2f9ad827e2fa] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:17.423736 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-85df8d46-2878-4637-951a-ddfdb44a6ed3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:17.424187 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-85df8d46-2878-4637-951a-ddfdb44a6ed3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:17.424951 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-85df8d46-2878-4637-951a-ddfdb44a6ed3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:17.425387 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-85df8d46-2878-4637-951a-ddfdb44a6ed3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:17.461145 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6c300bce-fc33-495a-80aa-0e92c96f5678 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:17.462059 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6c300bce-fc33-495a-80aa-0e92c96f5678 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:17.468468 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6c300bce-fc33-495a-80aa-0e92c96f5678 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:17.468911 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6c300bce-fc33-495a-80aa-0e92c96f5678 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:17.469765 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6c300bce-fc33-495a-80aa-0e92c96f5678 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:17.470199 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6c300bce-fc33-495a-80aa-0e92c96f5678 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:17.499077 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6c300bce-fc33-495a-80aa-0e92c96f5678 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041735 May 17 17:31:17.499656 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 468/883] 10.222.0.88 () {58 vars in 1301 bytes} [Tue May 17 17:31:17 2022] GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 17 17:31:17.554928 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-85df8d46-2878-4637-951a-ddfdb44a6ed3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:17.555091 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3c9c27d1-c92e-4b66-8f30-ed7deb523025 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:17.555560 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3c9c27d1-c92e-4b66-8f30-ed7deb523025 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:17.561986 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3c9c27d1-c92e-4b66-8f30-ed7deb523025 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:17.562433 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3c9c27d1-c92e-4b66-8f30-ed7deb523025 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:17.563174 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-85df8d46-2878-4637-951a-ddfdb44a6ed3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa" status: 200 len: 1264 microversion: 2.1 time: 0.151089 May 17 17:31:17.563296 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3c9c27d1-c92e-4b66-8f30-ed7deb523025 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:17.563634 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3c9c27d1-c92e-4b66-8f30-ed7deb523025 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:17.566772 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 416/884] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:17 2022] GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:17.588884 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3c9c27d1-c92e-4b66-8f30-ed7deb523025 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] Going to try to terminate instance {{(pid=117612) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:31:17.881677 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3c9c27d1-c92e-4b66-8f30-ed7deb523025 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "DELETE /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690" status: 204 len: 0 microversion: 2.1 time: 0.330074 May 17 17:31:17.882188 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 469/885] 10.222.0.88 () {58 vars in 1238 bytes} [Tue May 17 17:31:17 2022] DELETE /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 17 17:31:17.890694 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-45a5674b-364e-427a-9120-98ba2f73ee0f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:17.891300 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-45a5674b-364e-427a-9120-98ba2f73ee0f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:17.897198 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-45a5674b-364e-427a-9120-98ba2f73ee0f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:17.897865 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-45a5674b-364e-427a-9120-98ba2f73ee0f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:17.898809 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-45a5674b-364e-427a-9120-98ba2f73ee0f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:17.899251 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-45a5674b-364e-427a-9120-98ba2f73ee0f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:18.026551 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-45a5674b-364e-427a-9120-98ba2f73ee0f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:18.033812 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-45a5674b-364e-427a-9120-98ba2f73ee0f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690" status: 200 len: 1681 microversion: 2.1 time: 0.146849 May 17 17:31:18.035942 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 417/886] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:17 2022] GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:18.580281 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-66eeace3-4cfa-4926-b066-15ee7ebbbe2c tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:18.580973 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-66eeace3-4cfa-4926-b066-15ee7ebbbe2c tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 350d6927-4954-47cc-9754-2f9ad827e2fa] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:18.587205 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-66eeace3-4cfa-4926-b066-15ee7ebbbe2c tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:18.587685 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-66eeace3-4cfa-4926-b066-15ee7ebbbe2c tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:18.588442 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-66eeace3-4cfa-4926-b066-15ee7ebbbe2c tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:18.589379 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-66eeace3-4cfa-4926-b066-15ee7ebbbe2c tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:18.716008 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-66eeace3-4cfa-4926-b066-15ee7ebbbe2c tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:18.723197 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-66eeace3-4cfa-4926-b066-15ee7ebbbe2c tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa" status: 200 len: 1264 microversion: 2.1 time: 0.147113 May 17 17:31:18.723788 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 470/887] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:18 2022] GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:19.051130 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3f0694d4-375a-40fd-99f9-333042120a71 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:19.051814 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3f0694d4-375a-40fd-99f9-333042120a71 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:19.058153 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3f0694d4-375a-40fd-99f9-333042120a71 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:19.063719 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3f0694d4-375a-40fd-99f9-333042120a71 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:19.063719 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3f0694d4-375a-40fd-99f9-333042120a71 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:19.063719 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3f0694d4-375a-40fd-99f9-333042120a71 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:19.187963 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3f0694d4-375a-40fd-99f9-333042120a71 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:19.195085 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3f0694d4-375a-40fd-99f9-333042120a71 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690" status: 200 len: 1681 microversion: 2.1 time: 0.147939 May 17 17:31:19.195658 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 418/888] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:19 2022] GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:19.740604 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-81ce8da2-dc97-4f59-b532-8ffb66c542c5 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:19.741212 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-81ce8da2-dc97-4f59-b532-8ffb66c542c5 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 350d6927-4954-47cc-9754-2f9ad827e2fa] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:19.747508 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-81ce8da2-dc97-4f59-b532-8ffb66c542c5 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:19.747992 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-81ce8da2-dc97-4f59-b532-8ffb66c542c5 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:19.748755 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-81ce8da2-dc97-4f59-b532-8ffb66c542c5 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:19.749188 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-81ce8da2-dc97-4f59-b532-8ffb66c542c5 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:19.874541 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-81ce8da2-dc97-4f59-b532-8ffb66c542c5 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:19.881576 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-81ce8da2-dc97-4f59-b532-8ffb66c542c5 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa" status: 200 len: 1264 microversion: 2.1 time: 0.144794 May 17 17:31:19.882162 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 471/889] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:19 2022] GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa => generated 1264 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:20.212427 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4a4ad107-8246-4553-a378-99d4283173b2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:20.213041 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4a4ad107-8246-4553-a378-99d4283173b2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:20.219351 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4a4ad107-8246-4553-a378-99d4283173b2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:20.219841 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4a4ad107-8246-4553-a378-99d4283173b2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:20.227378 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4a4ad107-8246-4553-a378-99d4283173b2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:20.227378 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4a4ad107-8246-4553-a378-99d4283173b2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:20.413640 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4a4ad107-8246-4553-a378-99d4283173b2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:20.422518 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4a4ad107-8246-4553-a378-99d4283173b2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690" status: 200 len: 1681 microversion: 2.1 time: 0.213840 May 17 17:31:20.423084 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 419/890] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:20 2022] GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690 => generated 1681 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:20.898138 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b8e618cb-9b45-492a-a7cc-e0b7b8dd607d tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:20.898805 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b8e618cb-9b45-492a-a7cc-e0b7b8dd607d tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 350d6927-4954-47cc-9754-2f9ad827e2fa] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:20.905649 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b8e618cb-9b45-492a-a7cc-e0b7b8dd607d tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:20.906096 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b8e618cb-9b45-492a-a7cc-e0b7b8dd607d tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:20.906861 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b8e618cb-9b45-492a-a7cc-e0b7b8dd607d tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:20.907294 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b8e618cb-9b45-492a-a7cc-e0b7b8dd607d tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:21.128762 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b8e618cb-9b45-492a-a7cc-e0b7b8dd607d tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:21.136569 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b8e618cb-9b45-492a-a7cc-e0b7b8dd607d tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa" status: 200 len: 1264 microversion: 2.1 time: 0.242327 May 17 17:31:21.137143 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 472/891] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:20 2022] GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa => generated 1264 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:21.295318 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-6a0b94c8-3254-405d-99df-3973ab03cf6e req-890766ba-cbc0-4b80-9590-aabb8ec797e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ace49a2e-2ed3-43e0-a7c4-e275251ff690", "name": "network-vif-deleted", "tag": "2a8d5fdf-e913-47e8-a4f2-a122eca6ae7c"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:31:21.303886 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-6a0b94c8-3254-405d-99df-3973ab03cf6e req-890766ba-cbc0-4b80-9590-aabb8ec797e5 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:21.304332 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-6a0b94c8-3254-405d-99df-3973ab03cf6e req-890766ba-cbc0-4b80-9590-aabb8ec797e5 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:21.316537 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-6a0b94c8-3254-405d-99df-3973ab03cf6e req-890766ba-cbc0-4b80-9590-aabb8ec797e5 service nova] Creating event network-vif-deleted:2a8d5fdf-e913-47e8-a4f2-a122eca6ae7c for instance ace49a2e-2ed3-43e0-a7c4-e275251ff690 on hv-cinder-84214 May 17 17:31:21.321817 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-6a0b94c8-3254-405d-99df-3973ab03cf6e req-890766ba-cbc0-4b80-9590-aabb8ec797e5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030466 May 17 17:31:21.322541 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 420/892] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:31:21.440671 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b40e4c72-c1b7-4f78-9a91-b3432b5f913e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:21.441738 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b40e4c72-c1b7-4f78-9a91-b3432b5f913e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:21.448690 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b40e4c72-c1b7-4f78-9a91-b3432b5f913e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:21.449143 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b40e4c72-c1b7-4f78-9a91-b3432b5f913e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:21.450122 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b40e4c72-c1b7-4f78-9a91-b3432b5f913e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:21.450740 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b40e4c72-c1b7-4f78-9a91-b3432b5f913e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:21.514651 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b40e4c72-c1b7-4f78-9a91-b3432b5f913e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:21.522134 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b40e4c72-c1b7-4f78-9a91-b3432b5f913e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690" status: 200 len: 1325 microversion: 2.1 time: 0.085790 May 17 17:31:21.522692 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 473/893] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:21 2022] GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690 => generated 1325 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:22.154940 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6336d7b7-4523-4c3f-bb83-3e4a8f126e44 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:22.158109 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6336d7b7-4523-4c3f-bb83-3e4a8f126e44 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 350d6927-4954-47cc-9754-2f9ad827e2fa] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:22.162193 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6336d7b7-4523-4c3f-bb83-3e4a8f126e44 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:22.162644 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6336d7b7-4523-4c3f-bb83-3e4a8f126e44 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:22.163775 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6336d7b7-4523-4c3f-bb83-3e4a8f126e44 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:22.164217 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6336d7b7-4523-4c3f-bb83-3e4a8f126e44 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:22.317572 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6336d7b7-4523-4c3f-bb83-3e4a8f126e44 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:22.325137 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6336d7b7-4523-4c3f-bb83-3e4a8f126e44 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa" status: 200 len: 1264 microversion: 2.1 time: 0.175066 May 17 17:31:22.325709 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 421/894] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:22 2022] GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:22.395479 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-38de3905-781f-440e-b5f3-3625452116fb req-b699813b-9852-4a04-a028-4d127a0492b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "350d6927-4954-47cc-9754-2f9ad827e2fa", "name": "network-vif-plugged", "status": "completed", "tag": "ee4b9620-180f-492b-accb-1763e0c6c58b"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:31:22.408201 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-38de3905-781f-440e-b5f3-3625452116fb req-b699813b-9852-4a04-a028-4d127a0492b7 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:22.408201 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-38de3905-781f-440e-b5f3-3625452116fb req-b699813b-9852-4a04-a028-4d127a0492b7 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:22.417760 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-38de3905-781f-440e-b5f3-3625452116fb req-b699813b-9852-4a04-a028-4d127a0492b7 service nova] Creating event network-vif-plugged:ee4b9620-180f-492b-accb-1763e0c6c58b for instance 350d6927-4954-47cc-9754-2f9ad827e2fa on hv-cinder-84214 May 17 17:31:22.422658 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-38de3905-781f-440e-b5f3-3625452116fb req-b699813b-9852-4a04-a028-4d127a0492b7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030896 May 17 17:31:22.423238 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 474/895] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:31:22.538539 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ce8bf2fd-106d-4e23-93f2-9b6d8ca5bffc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:22.539580 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ce8bf2fd-106d-4e23-93f2-9b6d8ca5bffc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:22.546276 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ce8bf2fd-106d-4e23-93f2-9b6d8ca5bffc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:22.546733 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ce8bf2fd-106d-4e23-93f2-9b6d8ca5bffc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:22.547584 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ce8bf2fd-106d-4e23-93f2-9b6d8ca5bffc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:22.548022 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ce8bf2fd-106d-4e23-93f2-9b6d8ca5bffc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:22.561659 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-ce8bf2fd-106d-4e23-93f2-9b6d8ca5bffc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] HTTP exception thrown: Instance ace49a2e-2ed3-43e0-a7c4-e275251ff690 could not be found. May 17 17:31:22.563287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ce8bf2fd-106d-4e23-93f2-9b6d8ca5bffc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Request method failure captured: May 17 17:31:22.563287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690 HTTP/1.1 May 17 17:31:22.563287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:31:22.563287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:31:22.563287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:31:22.563287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:31:22.563287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:31:22.563287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:31:22.563287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:31:22.563287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:31:22.563287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9tWg17ELpg_TTkWzbFxHdaAAQsss46MNpXjEEnfH7yXijN80XDWmxF0PUmXoUksbJKowpEVVnYtBVvoWuiL6GXCGYlSppsHPRNYd8MeFV0B2bmGGuVwLt685v1qI8gbaO7aXhyrZ0FembuKv9KvgsXW4ySi9m_Wz_eukMKqtMUcZBY May 17 17:31:22.563287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:31:22.563287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:31:22.563287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:31:22.563287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:31:22.563287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:31:22.563287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:31:22.563287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: ed4b8b6a551347b6a920e4cfb59b9480 May 17 17:31:22.563287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:31:22.563287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:31:22.563287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:31:22.565034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ed4b8b6a551347b6a920e4cfb59b9480", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:31:22.565034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:31:22.565034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: ed4b8b6a551347b6a920e4cfb59b9480 May 17 17:31:22.565034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:31:22.565034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-AttachVolumeNegativeTest-1113418987-project May 17 17:31:22.565034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:31:22.565034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:31:22.565034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 7b22bf1b41774f64b7a380d86ef3f72e May 17 17:31:22.565034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-AttachVolumeNegativeTest-1113418987-project May 17 17:31:22.565034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:31:22.565034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Instance ace49a2e-2ed3-43e0-a7c4-e275251ff690 could not be found. May 17 17:31:22.565034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': 'ace49a2e-2ed3-43e0-a7c4-e275251ff690'} May 17 17:31:22.566171 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:31:22.566171 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:31:22.566171 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:31:22.566171 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:31:22.566171 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:31:22.566171 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:31:22.566171 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:31:22.566171 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:31:22.566171 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:31:22.566171 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:31:22.566171 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ace49a2e-2ed3-43e0-a7c4-e275251ff690 could not be found. May 17 17:31:22.566171 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:31:22.566171 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:31:22.566171 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:31:22.566171 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:31:22.566171 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:31:22.566171 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:31:22.566171 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:31:22.566171 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:31:22.566171 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:31:22.567835 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:31:22.567835 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:31:22.567835 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:31:22.567835 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:31:22.567835 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:31:22.567835 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:31:22.567835 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:31:22.567835 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ace49a2e-2ed3-43e0-a7c4-e275251ff690 could not be found. May 17 17:31:22.567835 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:31:22.567835 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:31:22.567835 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:31:22.567835 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:31:22.567835 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:31:22.567835 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:31:22.567835 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:31:22.567835 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:31:22.567835 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ace49a2e-2ed3-43e0-a7c4-e275251ff690 could not be found. May 17 17:31:22.567835 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:31:22.569397 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ce8bf2fd-106d-4e23-93f2-9b6d8ca5bffc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Returning 404 to user: Instance ace49a2e-2ed3-43e0-a7c4-e275251ff690 could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:31:22.569397 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ce8bf2fd-106d-4e23-93f2-9b6d8ca5bffc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690" status: 404 len: 111 microversion: 2.1 time: 0.030445 May 17 17:31:22.569397 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 422/896] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:22 2022] GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:31:22.573926 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8877bd6a-c427-48e4-ae8e-60775c73b0af tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '.version_select at 0x7f73d01f9700>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:22.719680 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8877bd6a-c427-48e4-ae8e-60775c73b0af tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-948066528" status: 202 len: 0 microversion: 2.1 time: 0.130986 May 17 17:31:22.719680 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 475/897] 10.222.0.88 () {58 vars in 1217 bytes} [Tue May 17 17:31:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-948066528 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:31:23.343327 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-0ede91c1-14d3-49e5-8b3c-f16fead23ba8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:23.344043 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-0ede91c1-14d3-49e5-8b3c-f16fead23ba8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 350d6927-4954-47cc-9754-2f9ad827e2fa] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:23.354209 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0ede91c1-14d3-49e5-8b3c-f16fead23ba8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:23.355172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0ede91c1-14d3-49e5-8b3c-f16fead23ba8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:23.356008 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0ede91c1-14d3-49e5-8b3c-f16fead23ba8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:23.356444 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0ede91c1-14d3-49e5-8b3c-f16fead23ba8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:23.432888 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4bc03a99-8656-43c5-8b34-1dfdf6cdbaa8 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Action: 'create', calling method: .version_select at 0x7f73d49f91f0>, body: {"keypair": {"name": "tempest-keypair-82455427", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkgjQuVMYnKPqkl7fsHekfZdvL50ZeEKzyuLXH13vC/IsjxQSZLnqBNkQGjOBBfPw/4pLxErhEYDmvPb5wbym+Gt7Dnhp+1Vt7YTDF3Qbd6ULGhHpSdGKG9lbxfaxJUoA=="}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:31:23.449967 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-4bc03a99-8656-43c5-8b34-1dfdf6cdbaa8 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Getting quotas for project ed4b8b6a551347b6a920e4cfb59b9480. Resources: {'key_pairs'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:31:23.454347 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-4bc03a99-8656-43c5-8b34-1dfdf6cdbaa8 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Getting quotas for user 7b22bf1b41774f64b7a380d86ef3f72e and project ed4b8b6a551347b6a920e4cfb59b9480. Resources: {'key_pairs'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:31:23.490928 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-0ede91c1-14d3-49e5-8b3c-f16fead23ba8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:23.498126 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-0ede91c1-14d3-49e5-8b3c-f16fead23ba8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa" status: 200 len: 1264 microversion: 2.1 time: 0.160228 May 17 17:31:23.498690 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 423/898] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:23 2022] GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:23.531387 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4bc03a99-8656-43c5-8b34-1dfdf6cdbaa8 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.102408 May 17 17:31:23.532011 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 476/899] 10.222.0.88 () {60 vars in 1158 bytes} [Tue May 17 17:31:23 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:31:24.514795 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4b01e033-49eb-4bf4-8a3b-2eb7df93f73b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:24.515475 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4b01e033-49eb-4bf4-8a3b-2eb7df93f73b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 350d6927-4954-47cc-9754-2f9ad827e2fa] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:24.522045 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4b01e033-49eb-4bf4-8a3b-2eb7df93f73b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:24.522495 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4b01e033-49eb-4bf4-8a3b-2eb7df93f73b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:24.523263 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4b01e033-49eb-4bf4-8a3b-2eb7df93f73b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:24.523732 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4b01e033-49eb-4bf4-8a3b-2eb7df93f73b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:24.654999 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4b01e033-49eb-4bf4-8a3b-2eb7df93f73b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:24.662354 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4b01e033-49eb-4bf4-8a3b-2eb7df93f73b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa" status: 200 len: 1451 microversion: 2.1 time: 0.151433 May 17 17:31:24.663166 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 424/900] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:24 2022] GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:24.679046 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-9799c66c-e5fa-4217-9440-9c86d36c5a18 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:24.679804 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-9799c66c-e5fa-4217-9440-9c86d36c5a18 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 350d6927-4954-47cc-9754-2f9ad827e2fa] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:24.686404 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9799c66c-e5fa-4217-9440-9c86d36c5a18 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:24.686852 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9799c66c-e5fa-4217-9440-9c86d36c5a18 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:24.687655 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9799c66c-e5fa-4217-9440-9c86d36c5a18 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:24.688091 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9799c66c-e5fa-4217-9440-9c86d36c5a18 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:24.822228 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-9799c66c-e5fa-4217-9440-9c86d36c5a18 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:24.829910 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-9799c66c-e5fa-4217-9440-9c86d36c5a18 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa" status: 200 len: 1451 microversion: 2.1 time: 0.154670 May 17 17:31:24.830501 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 477/901] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:24 2022] GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:26.025480 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-39c4cf74-cfbc-488f-8d0e-0ce290fb2bdf tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1176361289", "imageRef": "800c492c-ff69-4735-b2c9-a2dcaa20aa8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ace36e5-8f62-484d-869a-4e76e67d3437"}], "security_groups": [{"name": "tempest-securitygroup--628002807"}], "key_name": "tempest-keypair-82455427", "user_data": "}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:31:26.177663 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.network.neutron [None req-39c4cf74-cfbc-488f-8d0e-0ce290fb2bdf tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] validate_networks() for [('1ace36e5-8f62-484d-869a-4e76e67d3437', None, None, None, None, None)] {{(pid=117611) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:31:27.039349 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-39c4cf74-cfbc-488f-8d0e-0ce290fb2bdf tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Flavor limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:31:27.039950 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-39c4cf74-cfbc-488f-8d0e-0ce290fb2bdf tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Image limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:31:27.040259 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-39c4cf74-cfbc-488f-8d0e-0ce290fb2bdf tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Flavor pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:31:27.040753 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-39c4cf74-cfbc-488f-8d0e-0ce290fb2bdf tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Image pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:31:27.041162 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-39c4cf74-cfbc-488f-8d0e-0ce290fb2bdf tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:31:27.050457 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-39c4cf74-cfbc-488f-8d0e-0ce290fb2bdf tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:27.050905 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-39c4cf74-cfbc-488f-8d0e-0ce290fb2bdf tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:27.051746 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-39c4cf74-cfbc-488f-8d0e-0ce290fb2bdf tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:27.052266 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-39c4cf74-cfbc-488f-8d0e-0ce290fb2bdf tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:27.068323 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-39c4cf74-cfbc-488f-8d0e-0ce290fb2bdf tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Getting quotas for project ed4b8b6a551347b6a920e4cfb59b9480. Resources: {'cores', 'ram', 'instances'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:31:27.072219 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-39c4cf74-cfbc-488f-8d0e-0ce290fb2bdf tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Getting quotas for user 7b22bf1b41774f64b7a380d86ef3f72e and project ed4b8b6a551347b6a920e4cfb59b9480. Resources: {'cores', 'ram', 'instances'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:31:27.083258 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-39c4cf74-cfbc-488f-8d0e-0ce290fb2bdf tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Going to run 1 instances... {{(pid=117611) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:31:27.085535 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-39c4cf74-cfbc-488f-8d0e-0ce290fb2bdf tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 62f54293-2cef-4912-b3e4-1dfa60ca079a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='800c492c-ff69-4735-b2c9-a2dcaa20aa8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:31:27.220867 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-39c4cf74-cfbc-488f-8d0e-0ce290fb2bdf tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.199546 May 17 17:31:27.221515 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 425/902] 10.222.0.88 () {60 vars in 1146 bytes} [Tue May 17 17:31:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 1201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:31:27.232198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1c2fd3ef-e6ad-4e3f-9cd9-9604b1893935 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:27.232814 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1c2fd3ef-e6ad-4e3f-9cd9-9604b1893935 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 62f54293-2cef-4912-b3e4-1dfa60ca079a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:27.315752 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1c2fd3ef-e6ad-4e3f-9cd9-9604b1893935 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:27.323417 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1c2fd3ef-e6ad-4e3f-9cd9-9604b1893935 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a" status: 200 len: 1240 microversion: 2.1 time: 0.095094 May 17 17:31:27.324092 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 478/903] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:27 2022] GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a => generated 1240 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:27.443424 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-27864c7b-3064-4d73-8fe3-57f42a522c22 req-efc21e03-bc65-45f1-acd2-c28bcecb65b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "350d6927-4954-47cc-9754-2f9ad827e2fa", "tag": "ee4b9620-180f-492b-accb-1763e0c6c58b"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:31:27.453839 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-27864c7b-3064-4d73-8fe3-57f42a522c22 req-efc21e03-bc65-45f1-acd2-c28bcecb65b7 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:27.453839 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-27864c7b-3064-4d73-8fe3-57f42a522c22 req-efc21e03-bc65-45f1-acd2-c28bcecb65b7 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:27.463403 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-27864c7b-3064-4d73-8fe3-57f42a522c22 req-efc21e03-bc65-45f1-acd2-c28bcecb65b7 service nova] Creating event network-changed:ee4b9620-180f-492b-accb-1763e0c6c58b for instance 350d6927-4954-47cc-9754-2f9ad827e2fa on hv-cinder-84214 May 17 17:31:27.468727 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-27864c7b-3064-4d73-8fe3-57f42a522c22 req-efc21e03-bc65-45f1-acd2-c28bcecb65b7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028700 May 17 17:31:27.469493 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 426/904] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:31:28.340133 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-443b8f75-3d34-4fcc-b7af-a0feb887beec tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:28.340665 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-443b8f75-3d34-4fcc-b7af-a0feb887beec tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 62f54293-2cef-4912-b3e4-1dfa60ca079a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:28.347632 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-443b8f75-3d34-4fcc-b7af-a0feb887beec tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:28.348095 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-443b8f75-3d34-4fcc-b7af-a0feb887beec tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:28.348868 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-443b8f75-3d34-4fcc-b7af-a0feb887beec tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:28.349303 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-443b8f75-3d34-4fcc-b7af-a0feb887beec tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:28.409387 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-443b8f75-3d34-4fcc-b7af-a0feb887beec tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:28.416863 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-443b8f75-3d34-4fcc-b7af-a0feb887beec tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a" status: 200 len: 1244 microversion: 2.1 time: 0.080800 May 17 17:31:28.417409 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 479/905] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:28 2022] GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:29.433634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f070b3e5-8bf1-460b-b501-d451c1bfe7c5 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:29.434312 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f070b3e5-8bf1-460b-b501-d451c1bfe7c5 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 62f54293-2cef-4912-b3e4-1dfa60ca079a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:29.440795 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f070b3e5-8bf1-460b-b501-d451c1bfe7c5 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:29.441242 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f070b3e5-8bf1-460b-b501-d451c1bfe7c5 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:29.442063 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f070b3e5-8bf1-460b-b501-d451c1bfe7c5 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:29.442422 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f070b3e5-8bf1-460b-b501-d451c1bfe7c5 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:29.516025 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f070b3e5-8bf1-460b-b501-d451c1bfe7c5 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:29.523115 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f070b3e5-8bf1-460b-b501-d451c1bfe7c5 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a" status: 200 len: 1298 microversion: 2.1 time: 0.094171 May 17 17:31:29.523700 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 427/906] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:29 2022] GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:30.546530 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b1e92b27-9fcb-4168-b3b0-84c7942a679b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:30.548335 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b1e92b27-9fcb-4168-b3b0-84c7942a679b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 62f54293-2cef-4912-b3e4-1dfa60ca079a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:30.556268 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b1e92b27-9fcb-4168-b3b0-84c7942a679b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:30.556861 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b1e92b27-9fcb-4168-b3b0-84c7942a679b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:30.558232 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b1e92b27-9fcb-4168-b3b0-84c7942a679b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:30.558820 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b1e92b27-9fcb-4168-b3b0-84c7942a679b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:30.742337 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b1e92b27-9fcb-4168-b3b0-84c7942a679b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:30.749703 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b1e92b27-9fcb-4168-b3b0-84c7942a679b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a" status: 200 len: 1365 microversion: 2.1 time: 0.213446 May 17 17:31:30.750273 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 480/907] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:30 2022] GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:30.921142 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-e3597264-c140-437c-8e4d-3b643803e575 req-8fd00391-62ee-48d6-978e-030bcaeb9533 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62f54293-2cef-4912-b3e4-1dfa60ca079a", "tag": "63b7d101-b1c8-42e4-8eb9-6d204edacef6"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:31:30.930951 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-e3597264-c140-437c-8e4d-3b643803e575 req-8fd00391-62ee-48d6-978e-030bcaeb9533 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:30.933416 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-e3597264-c140-437c-8e4d-3b643803e575 req-8fd00391-62ee-48d6-978e-030bcaeb9533 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:30.943469 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-e3597264-c140-437c-8e4d-3b643803e575 req-8fd00391-62ee-48d6-978e-030bcaeb9533 service nova] Creating event network-changed:63b7d101-b1c8-42e4-8eb9-6d204edacef6 for instance 62f54293-2cef-4912-b3e4-1dfa60ca079a on hv-cinder-84214 May 17 17:31:30.948309 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-e3597264-c140-437c-8e4d-3b643803e575 req-8fd00391-62ee-48d6-978e-030bcaeb9533 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032354 May 17 17:31:30.949224 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 428/908] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:31:31.766531 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-683b0250-0e57-4600-a60c-d3e5725c6a3a tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:31.767140 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-683b0250-0e57-4600-a60c-d3e5725c6a3a tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 62f54293-2cef-4912-b3e4-1dfa60ca079a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:31.773381 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-683b0250-0e57-4600-a60c-d3e5725c6a3a tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:31.773825 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-683b0250-0e57-4600-a60c-d3e5725c6a3a tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:31.774577 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-683b0250-0e57-4600-a60c-d3e5725c6a3a tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:31.775011 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-683b0250-0e57-4600-a60c-d3e5725c6a3a tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:31.903262 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-683b0250-0e57-4600-a60c-d3e5725c6a3a tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:31.910373 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-683b0250-0e57-4600-a60c-d3e5725c6a3a tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a" status: 200 len: 1365 microversion: 2.1 time: 0.147649 May 17 17:31:31.910928 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 481/909] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:31 2022] GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:32.928666 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5c53ff7e-1b7e-426e-aaa1-c8a7ec6546ad tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:32.929387 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-5c53ff7e-1b7e-426e-aaa1-c8a7ec6546ad tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 62f54293-2cef-4912-b3e4-1dfa60ca079a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:32.935479 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5c53ff7e-1b7e-426e-aaa1-c8a7ec6546ad tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:32.935957 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5c53ff7e-1b7e-426e-aaa1-c8a7ec6546ad tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:32.936719 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5c53ff7e-1b7e-426e-aaa1-c8a7ec6546ad tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:32.937154 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5c53ff7e-1b7e-426e-aaa1-c8a7ec6546ad tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:33.062187 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-5c53ff7e-1b7e-426e-aaa1-c8a7ec6546ad tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:33.069489 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5c53ff7e-1b7e-426e-aaa1-c8a7ec6546ad tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a" status: 200 len: 1365 microversion: 2.1 time: 0.145407 May 17 17:31:33.070054 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 429/910] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:32 2022] GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:34.086446 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f8c911d5-6bd7-462c-aef4-d3803b15d99b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:34.087075 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f8c911d5-6bd7-462c-aef4-d3803b15d99b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 62f54293-2cef-4912-b3e4-1dfa60ca079a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:34.093196 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f8c911d5-6bd7-462c-aef4-d3803b15d99b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:34.093653 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f8c911d5-6bd7-462c-aef4-d3803b15d99b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:34.094427 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f8c911d5-6bd7-462c-aef4-d3803b15d99b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:34.094874 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f8c911d5-6bd7-462c-aef4-d3803b15d99b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:34.226258 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f8c911d5-6bd7-462c-aef4-d3803b15d99b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:34.234043 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f8c911d5-6bd7-462c-aef4-d3803b15d99b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a" status: 200 len: 1365 microversion: 2.1 time: 0.151562 May 17 17:31:34.234597 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 482/911] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:34 2022] GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:35.250682 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-0b14da9e-1cf8-44b6-9566-20410f7332be tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:35.251283 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-0b14da9e-1cf8-44b6-9566-20410f7332be tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 62f54293-2cef-4912-b3e4-1dfa60ca079a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:35.257593 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0b14da9e-1cf8-44b6-9566-20410f7332be tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:35.258041 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0b14da9e-1cf8-44b6-9566-20410f7332be tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:35.258798 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0b14da9e-1cf8-44b6-9566-20410f7332be tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:35.259233 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0b14da9e-1cf8-44b6-9566-20410f7332be tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:35.386019 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-0b14da9e-1cf8-44b6-9566-20410f7332be tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:35.393225 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-0b14da9e-1cf8-44b6-9566-20410f7332be tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a" status: 200 len: 1365 microversion: 2.1 time: 0.146375 May 17 17:31:35.393783 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 430/912] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:35 2022] GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:36.346097 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-2164cb11-5872-4ec5-9039-332bf38287ef req-55f67c30-ac17-4a4a-acd2-97044ce279fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f54293-2cef-4912-b3e4-1dfa60ca079a", "name": "network-vif-plugged", "status": "completed", "tag": "63b7d101-b1c8-42e4-8eb9-6d204edacef6"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:31:36.356414 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-2164cb11-5872-4ec5-9039-332bf38287ef req-55f67c30-ac17-4a4a-acd2-97044ce279fd service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:36.356414 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-2164cb11-5872-4ec5-9039-332bf38287ef req-55f67c30-ac17-4a4a-acd2-97044ce279fd service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:36.366041 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-2164cb11-5872-4ec5-9039-332bf38287ef req-55f67c30-ac17-4a4a-acd2-97044ce279fd service nova] Creating event network-vif-plugged:63b7d101-b1c8-42e4-8eb9-6d204edacef6 for instance 62f54293-2cef-4912-b3e4-1dfa60ca079a on hv-cinder-84214 May 17 17:31:36.371594 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-2164cb11-5872-4ec5-9039-332bf38287ef req-55f67c30-ac17-4a4a-acd2-97044ce279fd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029141 May 17 17:31:36.372164 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 483/913] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:31:36.409292 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e6e10de4-ef2a-498e-98de-da601590792c tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:36.409910 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e6e10de4-ef2a-498e-98de-da601590792c tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 62f54293-2cef-4912-b3e4-1dfa60ca079a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:36.417062 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e6e10de4-ef2a-498e-98de-da601590792c tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:36.417509 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e6e10de4-ef2a-498e-98de-da601590792c tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:36.418303 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e6e10de4-ef2a-498e-98de-da601590792c tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:36.418735 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e6e10de4-ef2a-498e-98de-da601590792c tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:36.553089 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e6e10de4-ef2a-498e-98de-da601590792c tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:36.560526 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e6e10de4-ef2a-498e-98de-da601590792c tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a" status: 200 len: 1365 microversion: 2.1 time: 0.155090 May 17 17:31:36.561098 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 431/914] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:36 2022] GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:37.578201 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1ffeba4d-4961-4b9a-b880-955a3c8501d2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:37.578881 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1ffeba4d-4961-4b9a-b880-955a3c8501d2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 62f54293-2cef-4912-b3e4-1dfa60ca079a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:37.585161 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1ffeba4d-4961-4b9a-b880-955a3c8501d2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:37.585609 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1ffeba4d-4961-4b9a-b880-955a3c8501d2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:37.586360 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1ffeba4d-4961-4b9a-b880-955a3c8501d2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:37.586790 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1ffeba4d-4961-4b9a-b880-955a3c8501d2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:37.714419 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1ffeba4d-4961-4b9a-b880-955a3c8501d2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:37.721678 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1ffeba4d-4961-4b9a-b880-955a3c8501d2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a" status: 200 len: 1365 microversion: 2.1 time: 0.148132 May 17 17:31:37.722239 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 484/915] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:37 2022] GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:38.738232 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-9610ece4-6745-46e4-824f-109e46e3fa15 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:38.738745 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-9610ece4-6745-46e4-824f-109e46e3fa15 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 62f54293-2cef-4912-b3e4-1dfa60ca079a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:38.745701 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9610ece4-6745-46e4-824f-109e46e3fa15 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:38.746182 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9610ece4-6745-46e4-824f-109e46e3fa15 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:38.746945 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9610ece4-6745-46e4-824f-109e46e3fa15 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:38.747406 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9610ece4-6745-46e4-824f-109e46e3fa15 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:38.873076 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-9610ece4-6745-46e4-824f-109e46e3fa15 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:31:38.880284 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-9610ece4-6745-46e4-824f-109e46e3fa15 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a" status: 200 len: 1555 microversion: 2.1 time: 0.146028 May 17 17:31:38.880850 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 432/916] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:31:38 2022] GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a => generated 1555 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:31:38.896944 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d99a543d-e9ff-4ede-812d-db5e6b8a5a7f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:31:38.897437 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d99a543d-e9ff-4ede-812d-db5e6b8a5a7f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 62f54293-2cef-4912-b3e4-1dfa60ca079a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:31:38.903765 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d99a543d-e9ff-4ede-812d-db5e6b8a5a7f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:38.904214 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d99a543d-e9ff-4ede-812d-db5e6b8a5a7f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:38.904981 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d99a543d-e9ff-4ede-812d-db5e6b8a5a7f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:38.905415 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d99a543d-e9ff-4ede-812d-db5e6b8a5a7f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:38.980286 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d99a543d-e9ff-4ede-812d-db5e6b8a5a7f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087086 May 17 17:31:38.980869 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 485/917] 10.222.0.88 () {58 vars in 1274 bytes} [Tue May 17 17:31:38 2022] GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:31:40.186408 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-4eda8587-88d6-4c26-8672-b01b62a32e70 req-9f4a39a3-b49c-4b4c-a82b-0931f01bb18d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62f54293-2cef-4912-b3e4-1dfa60ca079a", "tag": "63b7d101-b1c8-42e4-8eb9-6d204edacef6"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:31:40.194600 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-4eda8587-88d6-4c26-8672-b01b62a32e70 req-9f4a39a3-b49c-4b4c-a82b-0931f01bb18d service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:31:40.195035 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-4eda8587-88d6-4c26-8672-b01b62a32e70 req-9f4a39a3-b49c-4b4c-a82b-0931f01bb18d service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:31:40.205468 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-4eda8587-88d6-4c26-8672-b01b62a32e70 req-9f4a39a3-b49c-4b4c-a82b-0931f01bb18d service nova] Creating event network-changed:63b7d101-b1c8-42e4-8eb9-6d204edacef6 for instance 62f54293-2cef-4912-b3e4-1dfa60ca079a on hv-cinder-84214 May 17 17:31:40.210432 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-4eda8587-88d6-4c26-8672-b01b62a32e70 req-9f4a39a3-b49c-4b4c-a82b-0931f01bb18d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028170 May 17 17:31:40.211004 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 433/918] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:32:16.335686 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7f8ff0ee-1052-4313-a5c2-7361f30b6efd tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:32:16.336249 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-7f8ff0ee-1052-4313-a5c2-7361f30b6efd tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 62f54293-2cef-4912-b3e4-1dfa60ca079a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:32:16.341977 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7f8ff0ee-1052-4313-a5c2-7361f30b6efd tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:16.342418 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7f8ff0ee-1052-4313-a5c2-7361f30b6efd tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:16.343700 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7f8ff0ee-1052-4313-a5c2-7361f30b6efd tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:16.344131 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7f8ff0ee-1052-4313-a5c2-7361f30b6efd tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:16.366836 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7f8ff0ee-1052-4313-a5c2-7361f30b6efd tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a/ips" status: 200 len: 150 microversion: 2.1 time: 0.035713 May 17 17:32:16.367384 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 486/919] 10.222.0.88 () {58 vars in 1247 bytes} [Tue May 17 17:32:16 2022] GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:32:16.865306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 17:32:16.865468 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Tue May 17 17:32:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 17:32:18.037086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a31f9e2f-e675-40b7-9a84-1714ac543cc7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c03785e3-8972-44e8-9333-3c12d1fa97d6"}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:32:18.038600 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a31f9e2f-e675-40b7-9a84-1714ac543cc7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 62f54293-2cef-4912-b3e4-1dfa60ca079a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:32:18.044670 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a31f9e2f-e675-40b7-9a84-1714ac543cc7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:18.046823 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a31f9e2f-e675-40b7-9a84-1714ac543cc7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:18.046823 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a31f9e2f-e675-40b7-9a84-1714ac543cc7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:18.046823 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a31f9e2f-e675-40b7-9a84-1714ac543cc7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:19.078205 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a31f9e2f-e675-40b7-9a84-1714ac543cc7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "POST /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.045329 May 17 17:32:19.078876 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 434/920] 10.222.0.88 () {60 vars in 1322 bytes} [Tue May 17 17:32:18 2022] POST /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a/os-volume_attachments => generated 194 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:32:26.542283 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-fab2c401-cf22-4125-86b7-190305cca4c9 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c03785e3-8972-44e8-9333-3c12d1fa97d6"}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:32:26.543364 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-fab2c401-cf22-4125-86b7-190305cca4c9 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 62f54293-2cef-4912-b3e4-1dfa60ca079a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:32:26.550311 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fab2c401-cf22-4125-86b7-190305cca4c9 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:26.550790 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fab2c401-cf22-4125-86b7-190305cca4c9 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:26.551614 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fab2c401-cf22-4125-86b7-190305cca4c9 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:26.552145 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fab2c401-cf22-4125-86b7-190305cca4c9 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:26.681755 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-fab2c401-cf22-4125-86b7-190305cca4c9 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] HTTP exception thrown: Invalid volume: volume c03785e3-8972-44e8-9333-3c12d1fa97d6 is already attached to instances: 62f54293-2cef-4912-b3e4-1dfa60ca079a May 17 17:32:26.683462 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-fab2c401-cf22-4125-86b7-190305cca4c9 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Request method failure captured: May 17 17:32:26.683462 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: request: POST /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a/os-volume_attachments HTTP/1.1 May 17 17:32:26.683462 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 17 17:32:26.683462 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 17 17:32:26.683462 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Connection: close May 17 17:32:26.683462 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Length: 74 May 17 17:32:26.683462 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 17 17:32:26.683462 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.88 May 17 17:32:26.683462 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 17 17:32:26.683462 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 17 17:32:26.683462 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABig9tWg17ELpg_TTkWzbFxHdaAAQsss46MNpXjEEnfH7yXijN80XDWmxF0PUmXoUksbJKowpEVVnYtBVvoWuiL6GXCGYlSppsHPRNYd8MeFV0B2bmGGuVwLt685v1qI8gbaO7aXhyrZ0FembuKv9KvgsXW4ySi9m_Wz_eukMKqtMUcZBY May 17 17:32:26.683462 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 17 17:32:26.683462 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 17 17:32:26.683462 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 17 17:32:26.683462 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 17 17:32:26.683462 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 17 17:32:26.683462 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 17 17:32:26.683462 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Id: ed4b8b6a551347b6a920e4cfb59b9480 May 17 17:32:26.683462 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:32:26.683462 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Role: reader,member May 17 17:32:26.683462 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Roles: reader,member May 17 17:32:26.685194 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ed4b8b6a551347b6a920e4cfb59b9480", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:32:26.685194 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:32:26.685194 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: ed4b8b6a551347b6a920e4cfb59b9480 May 17 17:32:26.685194 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:32:26.685194 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeNegativeTest-1113418987-project May 17 17:32:26.685194 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 17 17:32:26.685194 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 17 17:32:26.685194 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Id: 7b22bf1b41774f64b7a380d86ef3f72e May 17 17:32:26.685194 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeNegativeTest-1113418987-project May 17 17:32:26.685194 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: May 17 17:32:26.685194 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {"volumeAttachment": {"volumeId": "c03785e3-8972-44e8-9333-3c12d1fa97d6"}} May 17 17:32:26.685194 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: method: > May 17 17:32:26.686162 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: exception: Invalid volume: volume c03785e3-8972-44e8-9333-3c12d1fa97d6 is already attached to instances: 62f54293-2cef-4912-b3e4-1dfa60ca079a May 17 17:32:26.686162 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: action_args: {'server_id': '62f54293-2cef-4912-b3e4-1dfa60ca079a', 'body': {'volumeAttachment': {'volumeId': 'c03785e3-8972-44e8-9333-3c12d1fa97d6'}}} May 17 17:32:26.686162 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:32:26.686162 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:32:26.686162 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 17 17:32:26.686162 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 17 17:32:26.686162 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 17 17:32:26.686162 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 17 17:32:26.686162 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 17 17:32:26.686162 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 17 17:32:26.686162 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 17 17:32:26.686162 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 17 17:32:26.686162 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 17 17:32:26.686162 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 17 17:32:26.686162 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c03785e3-8972-44e8-9333-3c12d1fa97d6 is already attached to instances: 62f54293-2cef-4912-b3e4-1dfa60ca079a May 17 17:32:26.686162 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:32:26.686162 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:32:26.686162 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:32:26.686162 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:32:26.687691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:32:26.687691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:32:26.687691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:32:26.687691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:32:26.687691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:32:26.687691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:32:26.687691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 17:32:26.687691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 17:32:26.687691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 17:32:26.687691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 17:32:26.687691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 17:32:26.687691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 17:32:26.687691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 17 17:32:26.687691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 17 17:32:26.687691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c03785e3-8972-44e8-9333-3c12d1fa97d6 is already attached to instances: 62f54293-2cef-4912-b3e4-1dfa60ca079a May 17 17:32:26.687691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:32:26.687691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:32:26.687691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:32:26.687691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:32:26.687691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:32:26.689394 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:32:26.689394 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:32:26.689394 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:32:26.689394 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c03785e3-8972-44e8-9333-3c12d1fa97d6 is already attached to instances: 62f54293-2cef-4912-b3e4-1dfa60ca079a May 17 17:32:26.689394 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:32:26.689394 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-fab2c401-cf22-4125-86b7-190305cca4c9 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Returning 400 to user: Invalid volume: volume c03785e3-8972-44e8-9333-3c12d1fa97d6 is already attached to instances: 62f54293-2cef-4912-b3e4-1dfa60ca079a {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:32:26.689394 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-fab2c401-cf22-4125-86b7-190305cca4c9 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "POST /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.146941 May 17 17:32:26.689394 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 487/921] 10.222.0.88 () {60 vars in 1322 bytes} [Tue May 17 17:32:26 2022] POST /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a/os-volume_attachments => generated 174 bytes in 148 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 17:32:26.744097 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4ac9fd83-5402-4747-951d-83585095b9ae tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:32:26.744679 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4ac9fd83-5402-4747-951d-83585095b9ae tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 62f54293-2cef-4912-b3e4-1dfa60ca079a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:32:26.750760 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4ac9fd83-5402-4747-951d-83585095b9ae tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:26.751214 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4ac9fd83-5402-4747-951d-83585095b9ae tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:26.752011 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4ac9fd83-5402-4747-951d-83585095b9ae tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:26.752452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4ac9fd83-5402-4747-951d-83585095b9ae tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:26.828689 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.objects.instance [None req-4ac9fd83-5402-4747-951d-83585095b9ae tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lazy-loading 'services' on Instance uuid 62f54293-2cef-4912-b3e4-1dfa60ca079a {{(pid=117611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:32:27.145353 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4ac9fd83-5402-4747-951d-83585095b9ae tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "DELETE /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a/os-volume_attachments/c03785e3-8972-44e8-9333-3c12d1fa97d6" status: 202 len: 0 microversion: 2.1 time: 0.405734 May 17 17:32:27.145896 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 435/922] 10.222.0.88 () {58 vars in 1415 bytes} [Tue May 17 17:32:26 2022] DELETE /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a/os-volume_attachments/c03785e3-8972-44e8-9333-3c12d1fa97d6 => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:32:27.154316 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b9722f34-fea4-465f-945f-1d14ccf56157 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:32:27.156051 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b9722f34-fea4-465f-945f-1d14ccf56157 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 62f54293-2cef-4912-b3e4-1dfa60ca079a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:32:27.162214 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b9722f34-fea4-465f-945f-1d14ccf56157 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:27.162666 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b9722f34-fea4-465f-945f-1d14ccf56157 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:27.163735 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b9722f34-fea4-465f-945f-1d14ccf56157 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:27.164171 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b9722f34-fea4-465f-945f-1d14ccf56157 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:27.192386 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b9722f34-fea4-465f-945f-1d14ccf56157 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042197 May 17 17:32:27.192926 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 488/923] 10.222.0.88 () {58 vars in 1301 bytes} [Tue May 17 17:32:27 2022] GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:32:28.205005 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e03258bd-4e6b-4376-bf46-e6781018352e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:32:28.206192 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e03258bd-4e6b-4376-bf46-e6781018352e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 62f54293-2cef-4912-b3e4-1dfa60ca079a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:32:28.212306 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e03258bd-4e6b-4376-bf46-e6781018352e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:28.212750 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e03258bd-4e6b-4376-bf46-e6781018352e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:28.213514 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e03258bd-4e6b-4376-bf46-e6781018352e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:28.213948 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e03258bd-4e6b-4376-bf46-e6781018352e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:28.242835 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e03258bd-4e6b-4376-bf46-e6781018352e tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042661 May 17 17:32:28.243378 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 436/924] 10.222.0.88 () {58 vars in 1301 bytes} [Tue May 17 17:32:28 2022] GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:32:29.255117 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-bff599f8-0c1c-4401-a816-912ee3fa70e0 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:32:29.256060 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-bff599f8-0c1c-4401-a816-912ee3fa70e0 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 62f54293-2cef-4912-b3e4-1dfa60ca079a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:32:29.262267 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bff599f8-0c1c-4401-a816-912ee3fa70e0 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:29.262708 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bff599f8-0c1c-4401-a816-912ee3fa70e0 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:29.263460 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bff599f8-0c1c-4401-a816-912ee3fa70e0 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:29.263919 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bff599f8-0c1c-4401-a816-912ee3fa70e0 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:29.290455 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-bff599f8-0c1c-4401-a816-912ee3fa70e0 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039253 May 17 17:32:29.290983 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 489/925] 10.222.0.88 () {58 vars in 1301 bytes} [Tue May 17 17:32:29 2022] GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a/os-volume_attachments => generated 25 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 17:32:29.345399 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-10d311ac-9adc-400d-afbc-63aa0cd78386 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:32:29.345887 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-10d311ac-9adc-400d-afbc-63aa0cd78386 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 62f54293-2cef-4912-b3e4-1dfa60ca079a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:32:29.352090 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-10d311ac-9adc-400d-afbc-63aa0cd78386 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:29.352544 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-10d311ac-9adc-400d-afbc-63aa0cd78386 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:29.353304 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-10d311ac-9adc-400d-afbc-63aa0cd78386 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:29.353737 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-10d311ac-9adc-400d-afbc-63aa0cd78386 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:29.378589 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-10d311ac-9adc-400d-afbc-63aa0cd78386 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 62f54293-2cef-4912-b3e4-1dfa60ca079a] Going to try to terminate instance {{(pid=117611) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:32:29.718621 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-10d311ac-9adc-400d-afbc-63aa0cd78386 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "DELETE /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a" status: 204 len: 0 microversion: 2.1 time: 0.376646 May 17 17:32:29.719210 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 437/926] 10.222.0.88 () {58 vars in 1238 bytes} [Tue May 17 17:32:29 2022] DELETE /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:32:29.727538 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8bd95075-bf54-4c70-adc3-30933413622a tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:32:29.730678 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8bd95075-bf54-4c70-adc3-30933413622a tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 62f54293-2cef-4912-b3e4-1dfa60ca079a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:32:29.734956 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8bd95075-bf54-4c70-adc3-30933413622a tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:29.735406 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8bd95075-bf54-4c70-adc3-30933413622a tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:29.736198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8bd95075-bf54-4c70-adc3-30933413622a tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:29.736630 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8bd95075-bf54-4c70-adc3-30933413622a tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:29.861193 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8bd95075-bf54-4c70-adc3-30933413622a tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:32:29.868399 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8bd95075-bf54-4c70-adc3-30933413622a tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a" status: 200 len: 1680 microversion: 2.1 time: 0.144800 May 17 17:32:29.868950 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 490/927] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:32:29 2022] GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a => generated 1680 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:32:30.885819 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-27c2d768-467c-4631-b64e-2fc3e18a4876 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:32:30.886453 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-27c2d768-467c-4631-b64e-2fc3e18a4876 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 62f54293-2cef-4912-b3e4-1dfa60ca079a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:32:30.893514 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-27c2d768-467c-4631-b64e-2fc3e18a4876 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:30.893962 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-27c2d768-467c-4631-b64e-2fc3e18a4876 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:30.894730 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-27c2d768-467c-4631-b64e-2fc3e18a4876 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:30.895191 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-27c2d768-467c-4631-b64e-2fc3e18a4876 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:31.024197 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-27c2d768-467c-4631-b64e-2fc3e18a4876 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:32:31.032112 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-27c2d768-467c-4631-b64e-2fc3e18a4876 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a" status: 200 len: 1680 microversion: 2.1 time: 0.150786 May 17 17:32:31.032703 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 438/928] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:32:30 2022] GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:32:32.049785 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c128080f-39b2-4cea-a112-d13d3a396ecb tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:32:32.050406 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c128080f-39b2-4cea-a112-d13d3a396ecb tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 62f54293-2cef-4912-b3e4-1dfa60ca079a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:32:32.056555 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c128080f-39b2-4cea-a112-d13d3a396ecb tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:32.057050 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c128080f-39b2-4cea-a112-d13d3a396ecb tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:32.057819 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c128080f-39b2-4cea-a112-d13d3a396ecb tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:32.058255 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c128080f-39b2-4cea-a112-d13d3a396ecb tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:32.155754 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c128080f-39b2-4cea-a112-d13d3a396ecb tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:32:32.163251 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c128080f-39b2-4cea-a112-d13d3a396ecb tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a" status: 200 len: 1613 microversion: 2.1 time: 0.117870 May 17 17:32:32.164120 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 491/929] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:32:32 2022] GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a => generated 1613 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:32:32.437896 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-34eac49a-851c-4de5-978c-52c0caa906f0 req-d22974c8-bbe3-40a3-8043-658e63f3b8c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f54293-2cef-4912-b3e4-1dfa60ca079a", "name": "network-vif-deleted", "tag": "63b7d101-b1c8-42e4-8eb9-6d204edacef6"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:32:32.446644 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-34eac49a-851c-4de5-978c-52c0caa906f0 req-d22974c8-bbe3-40a3-8043-658e63f3b8c7 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:32.452330 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-34eac49a-851c-4de5-978c-52c0caa906f0 req-d22974c8-bbe3-40a3-8043-658e63f3b8c7 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:32.459425 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-34eac49a-851c-4de5-978c-52c0caa906f0 req-d22974c8-bbe3-40a3-8043-658e63f3b8c7 service nova] Creating event network-vif-deleted:63b7d101-b1c8-42e4-8eb9-6d204edacef6 for instance 62f54293-2cef-4912-b3e4-1dfa60ca079a on hv-cinder-84214 May 17 17:32:32.464401 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-34eac49a-851c-4de5-978c-52c0caa906f0 req-d22974c8-bbe3-40a3-8043-658e63f3b8c7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090073 May 17 17:32:32.465001 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 439/930] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:32:33.180697 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-99191aa0-b86a-4abe-97de-74e871900f76 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:32:33.181336 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-99191aa0-b86a-4abe-97de-74e871900f76 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 62f54293-2cef-4912-b3e4-1dfa60ca079a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:32:33.188452 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-99191aa0-b86a-4abe-97de-74e871900f76 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:33.188899 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-99191aa0-b86a-4abe-97de-74e871900f76 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:33.189825 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-99191aa0-b86a-4abe-97de-74e871900f76 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:33.190254 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-99191aa0-b86a-4abe-97de-74e871900f76 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:33.221067 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-99191aa0-b86a-4abe-97de-74e871900f76 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:33.221439 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-99191aa0-b86a-4abe-97de-74e871900f76 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:33.221882 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-99191aa0-b86a-4abe-97de-74e871900f76 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lazy-loading 'fault' on Instance uuid 62f54293-2cef-4912-b3e4-1dfa60ca079a {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:32:33.266199 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-99191aa0-b86a-4abe-97de-74e871900f76 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:32:33.273531 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-99191aa0-b86a-4abe-97de-74e871900f76 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a" status: 200 len: 1330 microversion: 2.1 time: 0.096869 May 17 17:32:33.274095 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 492/931] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:32:33 2022] GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a => generated 1330 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:32:34.296605 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-0411d634-6677-497f-a6f8-311f278ab4fb tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:32:34.297260 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-0411d634-6677-497f-a6f8-311f278ab4fb tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 62f54293-2cef-4912-b3e4-1dfa60ca079a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:32:34.303390 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0411d634-6677-497f-a6f8-311f278ab4fb tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:34.303873 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0411d634-6677-497f-a6f8-311f278ab4fb tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:34.304636 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0411d634-6677-497f-a6f8-311f278ab4fb tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:34.305079 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0411d634-6677-497f-a6f8-311f278ab4fb tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:34.317954 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-0411d634-6677-497f-a6f8-311f278ab4fb tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] HTTP exception thrown: Instance 62f54293-2cef-4912-b3e4-1dfa60ca079a could not be found. May 17 17:32:34.319550 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-0411d634-6677-497f-a6f8-311f278ab4fb tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Request method failure captured: May 17 17:32:34.319550 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a HTTP/1.1 May 17 17:32:34.319550 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:32:34.319550 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:32:34.319550 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:32:34.319550 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:32:34.319550 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:32:34.319550 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:32:34.319550 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:32:34.319550 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:32:34.319550 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9tWg17ELpg_TTkWzbFxHdaAAQsss46MNpXjEEnfH7yXijN80XDWmxF0PUmXoUksbJKowpEVVnYtBVvoWuiL6GXCGYlSppsHPRNYd8MeFV0B2bmGGuVwLt685v1qI8gbaO7aXhyrZ0FembuKv9KvgsXW4ySi9m_Wz_eukMKqtMUcZBY May 17 17:32:34.319550 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:32:34.319550 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:32:34.319550 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:32:34.319550 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:32:34.319550 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:32:34.319550 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:32:34.319550 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: ed4b8b6a551347b6a920e4cfb59b9480 May 17 17:32:34.319550 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:32:34.319550 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:32:34.319550 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:32:34.321163 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ed4b8b6a551347b6a920e4cfb59b9480", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:32:34.321163 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:32:34.321163 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: ed4b8b6a551347b6a920e4cfb59b9480 May 17 17:32:34.321163 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:32:34.321163 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-AttachVolumeNegativeTest-1113418987-project May 17 17:32:34.321163 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:32:34.321163 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:32:34.321163 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 7b22bf1b41774f64b7a380d86ef3f72e May 17 17:32:34.321163 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-AttachVolumeNegativeTest-1113418987-project May 17 17:32:34.321163 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:32:34.321163 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Instance 62f54293-2cef-4912-b3e4-1dfa60ca079a could not be found. May 17 17:32:34.321163 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': '62f54293-2cef-4912-b3e4-1dfa60ca079a'} May 17 17:32:34.322086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:32:34.322086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:32:34.322086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:32:34.322086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:32:34.322086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:32:34.322086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:32:34.322086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:32:34.322086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:32:34.322086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:32:34.322086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:32:34.322086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62f54293-2cef-4912-b3e4-1dfa60ca079a could not be found. May 17 17:32:34.322086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:32:34.322086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:32:34.322086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:32:34.322086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:32:34.322086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:32:34.322086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:32:34.322086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:32:34.322086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:32:34.322086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:32:34.323614 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:32:34.323614 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:32:34.323614 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:32:34.323614 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:32:34.323614 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:32:34.323614 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:32:34.323614 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:32:34.323614 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62f54293-2cef-4912-b3e4-1dfa60ca079a could not be found. May 17 17:32:34.323614 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:32:34.323614 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:32:34.323614 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:32:34.323614 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:32:34.323614 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:32:34.323614 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:32:34.323614 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:32:34.323614 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:32:34.323614 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62f54293-2cef-4912-b3e4-1dfa60ca079a could not be found. May 17 17:32:34.323614 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:32:34.324928 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-0411d634-6677-497f-a6f8-311f278ab4fb tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Returning 404 to user: Instance 62f54293-2cef-4912-b3e4-1dfa60ca079a could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:32:34.324928 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-0411d634-6677-497f-a6f8-311f278ab4fb tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a" status: 404 len: 111 microversion: 2.1 time: 0.029711 May 17 17:32:34.324928 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 440/932] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:32:34 2022] GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:32:34.329467 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f02af453-fcc7-4ec1-9948-f533b13d3797 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '.version_select at 0x7f73d498f280>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:32:34.417996 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f02af453-fcc7-4ec1-9948-f533b13d3797 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-82455427" status: 202 len: 0 microversion: 2.1 time: 0.092309 May 17 17:32:34.418535 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 493/933] 10.222.0.88 () {58 vars in 1214 bytes} [Tue May 17 17:32:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-82455427 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:32:35.160033 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-501f8682-06fe-4239-b91e-8667fc858b28 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Action: 'create', calling method: .version_select at 0x7f73cb650040>, body: {"keypair": {"name": "tempest-keypair-325261136", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBNqO9+nDvJGGw3firl+/YnGiTkvaH7FYuuYFnc6XjAhZCgx5c5mDHFX+uwNnCyBbX2qJvyslw1zH9Crn2JrvDXeLiyPKYnz2MEZWsHaCvw2lbs88WVGLv+UZlgmyLvSg=="}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:32:35.174229 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-501f8682-06fe-4239-b91e-8667fc858b28 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Getting quotas for project ed4b8b6a551347b6a920e4cfb59b9480. Resources: {'key_pairs'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:32:35.178095 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-501f8682-06fe-4239-b91e-8667fc858b28 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Getting quotas for user 7b22bf1b41774f64b7a380d86ef3f72e and project ed4b8b6a551347b6a920e4cfb59b9480. Resources: {'key_pairs'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:32:35.189987 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR oslo.messaging._drivers.impl_rabbit [None req-501f8682-06fe-4239-b91e-8667fc858b28 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [7466f92d-dae7-45c4-8526-b2f54989947b] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 17 17:32:36.197256 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO oslo.messaging._drivers.impl_rabbit [None req-501f8682-06fe-4239-b91e-8667fc858b28 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [7466f92d-dae7-45c4-8526-b2f54989947b] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 38730. May 17 17:32:36.298044 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-501f8682-06fe-4239-b91e-8667fc858b28 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.141841 May 17 17:32:36.298547 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 441/934] 10.222.0.88 () {60 vars in 1158 bytes} [Tue May 17 17:32:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:32:38.738017 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d053da40-6a30-4e87-90de-61d8f645417b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1632275617", "imageRef": "800c492c-ff69-4735-b2c9-a2dcaa20aa8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ace36e5-8f62-484d-869a-4e76e67d3437"}], "security_groups": [{"name": "tempest-securitygroup--1609887396"}], "key_name": "tempest-keypair-325261136", "user_data": "}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:32:38.837134 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.network.neutron [None req-d053da40-6a30-4e87-90de-61d8f645417b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] validate_networks() for [('1ace36e5-8f62-484d-869a-4e76e67d3437', None, None, None, None, None)] {{(pid=117612) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:32:39.197871 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-d053da40-6a30-4e87-90de-61d8f645417b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Flavor limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:32:39.198323 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-d053da40-6a30-4e87-90de-61d8f645417b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Image limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:32:39.198802 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-d053da40-6a30-4e87-90de-61d8f645417b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Flavor pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:32:39.199209 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-d053da40-6a30-4e87-90de-61d8f645417b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Image pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:32:39.199648 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-d053da40-6a30-4e87-90de-61d8f645417b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:32:39.208139 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d053da40-6a30-4e87-90de-61d8f645417b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:39.208584 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d053da40-6a30-4e87-90de-61d8f645417b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:39.209384 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d053da40-6a30-4e87-90de-61d8f645417b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:39.209822 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d053da40-6a30-4e87-90de-61d8f645417b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:39.225532 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-d053da40-6a30-4e87-90de-61d8f645417b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Getting quotas for project ed4b8b6a551347b6a920e4cfb59b9480. Resources: {'cores', 'ram', 'instances'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:32:39.229392 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-d053da40-6a30-4e87-90de-61d8f645417b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Getting quotas for user 7b22bf1b41774f64b7a380d86ef3f72e and project ed4b8b6a551347b6a920e4cfb59b9480. Resources: {'cores', 'ram', 'instances'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:32:39.240436 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d053da40-6a30-4e87-90de-61d8f645417b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Going to run 1 instances... {{(pid=117612) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:32:39.242632 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d053da40-6a30-4e87-90de-61d8f645417b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 54c36578-fced-4088-bc46-ae0b0a74c557] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='800c492c-ff69-4735-b2c9-a2dcaa20aa8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:32:39.394479 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d053da40-6a30-4e87-90de-61d8f645417b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.661138 May 17 17:32:39.395038 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 494/935] 10.222.0.88 () {60 vars in 1146 bytes} [Tue May 17 17:32:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:32:39.408579 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c35ebe08-ac53-481e-8f31-e862aedf25c4 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:32:39.409171 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c35ebe08-ac53-481e-8f31-e862aedf25c4 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 54c36578-fced-4088-bc46-ae0b0a74c557] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:32:39.463361 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c35ebe08-ac53-481e-8f31-e862aedf25c4 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:32:39.469750 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c35ebe08-ac53-481e-8f31-e862aedf25c4 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557" status: 200 len: 1241 microversion: 2.1 time: 0.068516 May 17 17:32:39.470471 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 442/936] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:32:39 2022] GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:32:40.488036 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-422068a3-f280-4eb4-89a9-1140f7db4acb tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:32:40.488676 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-422068a3-f280-4eb4-89a9-1140f7db4acb tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 54c36578-fced-4088-bc46-ae0b0a74c557] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:32:40.494619 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-422068a3-f280-4eb4-89a9-1140f7db4acb tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:40.495504 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-422068a3-f280-4eb4-89a9-1140f7db4acb tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:40.495901 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-422068a3-f280-4eb4-89a9-1140f7db4acb tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:40.496337 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-422068a3-f280-4eb4-89a9-1140f7db4acb tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:40.560716 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-422068a3-f280-4eb4-89a9-1140f7db4acb tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:32:40.568154 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-422068a3-f280-4eb4-89a9-1140f7db4acb tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557" status: 200 len: 1245 microversion: 2.1 time: 0.085325 May 17 17:32:40.568708 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 495/937] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:32:40 2022] GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:32:41.585670 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8f082c04-c130-4265-8709-2e5c28fbf9e7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:32:41.586287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8f082c04-c130-4265-8709-2e5c28fbf9e7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 54c36578-fced-4088-bc46-ae0b0a74c557] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:32:41.592579 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8f082c04-c130-4265-8709-2e5c28fbf9e7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:41.593510 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8f082c04-c130-4265-8709-2e5c28fbf9e7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:41.594270 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8f082c04-c130-4265-8709-2e5c28fbf9e7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:41.595060 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8f082c04-c130-4265-8709-2e5c28fbf9e7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:41.667301 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8f082c04-c130-4265-8709-2e5c28fbf9e7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:32:41.675264 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8f082c04-c130-4265-8709-2e5c28fbf9e7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557" status: 200 len: 1301 microversion: 2.1 time: 0.093652 May 17 17:32:41.676154 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 443/938] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:32:41 2022] GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557 => generated 1301 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:32:42.693523 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-03085ccd-3c3a-4aa3-9d7f-624d0ff0e560 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:32:42.694162 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-03085ccd-3c3a-4aa3-9d7f-624d0ff0e560 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 54c36578-fced-4088-bc46-ae0b0a74c557] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:32:42.700433 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-03085ccd-3c3a-4aa3-9d7f-624d0ff0e560 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:42.705730 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-03085ccd-3c3a-4aa3-9d7f-624d0ff0e560 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:42.705730 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-03085ccd-3c3a-4aa3-9d7f-624d0ff0e560 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:42.705730 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-03085ccd-3c3a-4aa3-9d7f-624d0ff0e560 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:42.896242 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-03085ccd-3c3a-4aa3-9d7f-624d0ff0e560 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:32:42.903269 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-03085ccd-3c3a-4aa3-9d7f-624d0ff0e560 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557" status: 200 len: 1367 microversion: 2.1 time: 0.213632 May 17 17:32:42.904105 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 496/939] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:32:42 2022] GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:32:43.382277 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-e911f13d-fefa-4713-b4e4-4918c132c7ac req-62609f34-054c-46d4-a51e-17550e15ba44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54c36578-fced-4088-bc46-ae0b0a74c557", "tag": "1305375d-3df8-44bb-ab56-796b91f737c1"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:32:43.394203 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-e911f13d-fefa-4713-b4e4-4918c132c7ac req-62609f34-054c-46d4-a51e-17550e15ba44 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:43.394657 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-e911f13d-fefa-4713-b4e4-4918c132c7ac req-62609f34-054c-46d4-a51e-17550e15ba44 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:43.405952 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-e911f13d-fefa-4713-b4e4-4918c132c7ac req-62609f34-054c-46d4-a51e-17550e15ba44 service nova] Creating event network-changed:1305375d-3df8-44bb-ab56-796b91f737c1 for instance 54c36578-fced-4088-bc46-ae0b0a74c557 on hv-cinder-84214 May 17 17:32:43.411202 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-e911f13d-fefa-4713-b4e4-4918c132c7ac req-62609f34-054c-46d4-a51e-17550e15ba44 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040786 May 17 17:32:43.411866 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 444/940] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:32:43.920625 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f365a84a-acc2-4bc8-9837-48fc648d0479 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:32:43.921843 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f365a84a-acc2-4bc8-9837-48fc648d0479 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 54c36578-fced-4088-bc46-ae0b0a74c557] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:32:43.928034 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f365a84a-acc2-4bc8-9837-48fc648d0479 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:43.928488 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f365a84a-acc2-4bc8-9837-48fc648d0479 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:43.929261 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f365a84a-acc2-4bc8-9837-48fc648d0479 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:43.929726 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f365a84a-acc2-4bc8-9837-48fc648d0479 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:44.387322 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f365a84a-acc2-4bc8-9837-48fc648d0479 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:32:44.394986 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f365a84a-acc2-4bc8-9837-48fc648d0479 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557" status: 200 len: 1367 microversion: 2.1 time: 0.478402 May 17 17:32:44.395565 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 497/941] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:32:43 2022] GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557 => generated 1367 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:32:45.413249 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f27c1e58-831e-410f-aeed-18df451087c2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:32:45.414232 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f27c1e58-831e-410f-aeed-18df451087c2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 54c36578-fced-4088-bc46-ae0b0a74c557] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:32:45.420353 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f27c1e58-831e-410f-aeed-18df451087c2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:45.420818 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f27c1e58-831e-410f-aeed-18df451087c2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:45.422128 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f27c1e58-831e-410f-aeed-18df451087c2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:45.422568 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f27c1e58-831e-410f-aeed-18df451087c2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:45.549221 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f27c1e58-831e-410f-aeed-18df451087c2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:32:45.555961 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f27c1e58-831e-410f-aeed-18df451087c2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557" status: 200 len: 1367 microversion: 2.1 time: 0.147458 May 17 17:32:45.556529 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 445/942] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:32:45 2022] GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:32:46.572035 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ca68a3a4-c633-4169-856b-0e67066e2198 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:32:46.572630 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ca68a3a4-c633-4169-856b-0e67066e2198 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 54c36578-fced-4088-bc46-ae0b0a74c557] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:32:46.578923 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ca68a3a4-c633-4169-856b-0e67066e2198 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:46.579371 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ca68a3a4-c633-4169-856b-0e67066e2198 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:46.580173 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ca68a3a4-c633-4169-856b-0e67066e2198 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:46.580609 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ca68a3a4-c633-4169-856b-0e67066e2198 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:46.707334 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ca68a3a4-c633-4169-856b-0e67066e2198 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:32:46.714524 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ca68a3a4-c633-4169-856b-0e67066e2198 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557" status: 200 len: 1367 microversion: 2.1 time: 0.146340 May 17 17:32:46.715082 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 498/943] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:32:46 2022] GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:32:47.732524 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5ed1de71-6f2c-4fa0-866a-a3516d708217 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:32:47.733149 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-5ed1de71-6f2c-4fa0-866a-a3516d708217 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 54c36578-fced-4088-bc46-ae0b0a74c557] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:32:47.739777 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5ed1de71-6f2c-4fa0-866a-a3516d708217 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:47.740218 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5ed1de71-6f2c-4fa0-866a-a3516d708217 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:47.740978 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5ed1de71-6f2c-4fa0-866a-a3516d708217 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:47.741408 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5ed1de71-6f2c-4fa0-866a-a3516d708217 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:47.875024 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-5ed1de71-6f2c-4fa0-866a-a3516d708217 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:32:47.882058 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5ed1de71-6f2c-4fa0-866a-a3516d708217 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557" status: 200 len: 1367 microversion: 2.1 time: 0.153615 May 17 17:32:47.882614 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 446/944] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:32:47 2022] GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:32:48.899818 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-fad59090-bd42-455a-8ecd-136e8a75ad9a tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:32:48.900498 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-fad59090-bd42-455a-8ecd-136e8a75ad9a tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 54c36578-fced-4088-bc46-ae0b0a74c557] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:32:48.907206 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fad59090-bd42-455a-8ecd-136e8a75ad9a tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:48.907693 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fad59090-bd42-455a-8ecd-136e8a75ad9a tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:48.908512 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fad59090-bd42-455a-8ecd-136e8a75ad9a tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:48.908912 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fad59090-bd42-455a-8ecd-136e8a75ad9a tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:49.035674 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-fad59090-bd42-455a-8ecd-136e8a75ad9a tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:32:49.043293 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-fad59090-bd42-455a-8ecd-136e8a75ad9a tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557" status: 200 len: 1367 microversion: 2.1 time: 0.147365 May 17 17:32:49.043923 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 499/945] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:32:48 2022] GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:32:50.059963 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-53d4b0ca-3077-49cc-8761-634439158743 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:32:50.060567 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-53d4b0ca-3077-49cc-8761-634439158743 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 54c36578-fced-4088-bc46-ae0b0a74c557] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:32:50.067405 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-53d4b0ca-3077-49cc-8761-634439158743 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:50.067876 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-53d4b0ca-3077-49cc-8761-634439158743 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:50.068631 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-53d4b0ca-3077-49cc-8761-634439158743 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:50.069061 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-53d4b0ca-3077-49cc-8761-634439158743 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:50.193994 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-53d4b0ca-3077-49cc-8761-634439158743 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:32:50.201186 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-53d4b0ca-3077-49cc-8761-634439158743 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557" status: 200 len: 1367 microversion: 2.1 time: 0.145060 May 17 17:32:50.201741 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 447/946] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:32:50 2022] GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:32:50.695622 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-cc7dd099-5d19-4352-b9b8-ab6ca4f743da req-e8c943c2-9fe3-4f1d-b92b-8207cd26caca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c36578-fced-4088-bc46-ae0b0a74c557", "name": "network-vif-plugged", "status": "completed", "tag": "1305375d-3df8-44bb-ab56-796b91f737c1"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:32:50.703909 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-cc7dd099-5d19-4352-b9b8-ab6ca4f743da req-e8c943c2-9fe3-4f1d-b92b-8207cd26caca service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:50.704345 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-cc7dd099-5d19-4352-b9b8-ab6ca4f743da req-e8c943c2-9fe3-4f1d-b92b-8207cd26caca service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:50.714858 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-cc7dd099-5d19-4352-b9b8-ab6ca4f743da req-e8c943c2-9fe3-4f1d-b92b-8207cd26caca service nova] Creating event network-vif-plugged:1305375d-3df8-44bb-ab56-796b91f737c1 for instance 54c36578-fced-4088-bc46-ae0b0a74c557 on hv-cinder-84214 May 17 17:32:50.720273 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-cc7dd099-5d19-4352-b9b8-ab6ca4f743da req-e8c943c2-9fe3-4f1d-b92b-8207cd26caca service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028794 May 17 17:32:50.722473 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 500/947] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:32:51.219486 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-aa7f0a3a-9ea4-4748-852d-1c487e96f94b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:32:51.220164 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-aa7f0a3a-9ea4-4748-852d-1c487e96f94b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 54c36578-fced-4088-bc46-ae0b0a74c557] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:32:51.226701 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-aa7f0a3a-9ea4-4748-852d-1c487e96f94b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:51.227155 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-aa7f0a3a-9ea4-4748-852d-1c487e96f94b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:51.228002 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-aa7f0a3a-9ea4-4748-852d-1c487e96f94b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:51.228553 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-aa7f0a3a-9ea4-4748-852d-1c487e96f94b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:51.362885 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-aa7f0a3a-9ea4-4748-852d-1c487e96f94b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:32:51.370069 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-aa7f0a3a-9ea4-4748-852d-1c487e96f94b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557" status: 200 len: 1367 microversion: 2.1 time: 0.155124 May 17 17:32:51.370622 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 448/948] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:32:51 2022] GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:32:52.388194 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-bf06328f-d9b7-4f49-8d99-3f755646caf2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:32:52.388804 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-bf06328f-d9b7-4f49-8d99-3f755646caf2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 54c36578-fced-4088-bc46-ae0b0a74c557] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:32:52.394883 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bf06328f-d9b7-4f49-8d99-3f755646caf2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:52.395326 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bf06328f-d9b7-4f49-8d99-3f755646caf2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:52.396156 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bf06328f-d9b7-4f49-8d99-3f755646caf2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:52.396587 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bf06328f-d9b7-4f49-8d99-3f755646caf2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:52.531367 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-bf06328f-d9b7-4f49-8d99-3f755646caf2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:32:52.538786 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-bf06328f-d9b7-4f49-8d99-3f755646caf2 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557" status: 200 len: 1367 microversion: 2.1 time: 0.155048 May 17 17:32:52.539340 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 501/949] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:32:52 2022] GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:32:53.555635 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-62b50d3d-9f3c-4b79-bdb0-0ca8979fa2de tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:32:53.556267 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-62b50d3d-9f3c-4b79-bdb0-0ca8979fa2de tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 54c36578-fced-4088-bc46-ae0b0a74c557] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:32:53.562734 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-62b50d3d-9f3c-4b79-bdb0-0ca8979fa2de tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:53.563176 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-62b50d3d-9f3c-4b79-bdb0-0ca8979fa2de tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:53.563957 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-62b50d3d-9f3c-4b79-bdb0-0ca8979fa2de tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:53.564390 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-62b50d3d-9f3c-4b79-bdb0-0ca8979fa2de tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:53.692857 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-62b50d3d-9f3c-4b79-bdb0-0ca8979fa2de tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:32:53.700128 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-62b50d3d-9f3c-4b79-bdb0-0ca8979fa2de tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557" status: 200 len: 1557 microversion: 2.1 time: 0.148603 May 17 17:32:53.700680 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 449/950] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:32:53 2022] GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:32:53.716088 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3a282f76-f00f-4808-92b3-175ada759f99 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:32:53.716610 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3a282f76-f00f-4808-92b3-175ada759f99 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 54c36578-fced-4088-bc46-ae0b0a74c557] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:32:53.723362 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3a282f76-f00f-4808-92b3-175ada759f99 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:53.723879 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3a282f76-f00f-4808-92b3-175ada759f99 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:53.724655 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3a282f76-f00f-4808-92b3-175ada759f99 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:53.725096 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3a282f76-f00f-4808-92b3-175ada759f99 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:53.804447 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3a282f76-f00f-4808-92b3-175ada759f99 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092146 May 17 17:32:53.807653 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 502/951] 10.222.0.88 () {58 vars in 1274 bytes} [Tue May 17 17:32:53 2022] GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:32:54.758779 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-410f205e-5b3f-4fde-83b4-9b93d032217a req-1b665b74-95a4-4714-8a4c-e2be731ed4f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54c36578-fced-4088-bc46-ae0b0a74c557", "tag": "1305375d-3df8-44bb-ab56-796b91f737c1"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:32:54.767032 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-410f205e-5b3f-4fde-83b4-9b93d032217a req-1b665b74-95a4-4714-8a4c-e2be731ed4f3 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:32:54.767529 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-410f205e-5b3f-4fde-83b4-9b93d032217a req-1b665b74-95a4-4714-8a4c-e2be731ed4f3 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:32:54.777919 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-410f205e-5b3f-4fde-83b4-9b93d032217a req-1b665b74-95a4-4714-8a4c-e2be731ed4f3 service nova] Creating event network-changed:1305375d-3df8-44bb-ab56-796b91f737c1 for instance 54c36578-fced-4088-bc46-ae0b0a74c557 on hv-cinder-84214 May 17 17:32:54.782774 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-410f205e-5b3f-4fde-83b4-9b93d032217a req-1b665b74-95a4-4714-8a4c-e2be731ed4f3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027669 May 17 17:32:54.783369 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 450/952] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:33:07.357075 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b3f703b8-6301-4410-a0f2-fe58539440e3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:07.358314 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b3f703b8-6301-4410-a0f2-fe58539440e3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 350d6927-4954-47cc-9754-2f9ad827e2fa] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:07.359851 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-a81038f8-a37c-4251-8fe5-089e2b4d19c7 req-9d2081c4-00ae-4140-940a-6c88b4ada63f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "350d6927-4954-47cc-9754-2f9ad827e2fa", "tag": "ee4b9620-180f-492b-accb-1763e0c6c58b"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:33:07.364866 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b3f703b8-6301-4410-a0f2-fe58539440e3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:07.365433 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b3f703b8-6301-4410-a0f2-fe58539440e3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:07.366218 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b3f703b8-6301-4410-a0f2-fe58539440e3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:07.366655 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b3f703b8-6301-4410-a0f2-fe58539440e3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:07.367713 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-a81038f8-a37c-4251-8fe5-089e2b4d19c7 req-9d2081c4-00ae-4140-940a-6c88b4ada63f service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:07.368155 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-a81038f8-a37c-4251-8fe5-089e2b4d19c7 req-9d2081c4-00ae-4140-940a-6c88b4ada63f service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:07.383223 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-a81038f8-a37c-4251-8fe5-089e2b4d19c7 req-9d2081c4-00ae-4140-940a-6c88b4ada63f service nova] Creating event network-changed:ee4b9620-180f-492b-accb-1763e0c6c58b for instance 350d6927-4954-47cc-9754-2f9ad827e2fa on hv-cinder-84214 May 17 17:33:07.388258 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-a81038f8-a37c-4251-8fe5-089e2b4d19c7 req-9d2081c4-00ae-4140-940a-6c88b4ada63f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033298 May 17 17:33:07.389028 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 451/953] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:33:07.391627 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b3f703b8-6301-4410-a0f2-fe58539440e3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 350d6927-4954-47cc-9754-2f9ad827e2fa] Going to try to terminate instance {{(pid=117612) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:33:07.725893 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b3f703b8-6301-4410-a0f2-fe58539440e3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "DELETE /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa" status: 204 len: 0 microversion: 2.1 time: 0.373217 May 17 17:33:07.726473 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 503/954] 10.222.0.88 () {58 vars in 1238 bytes} [Tue May 17 17:33:07 2022] DELETE /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:33:07.735567 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5dbc9773-c21d-4b53-9fab-f6ce16436ac6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:07.736262 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-5dbc9773-c21d-4b53-9fab-f6ce16436ac6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 350d6927-4954-47cc-9754-2f9ad827e2fa] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:07.742226 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5dbc9773-c21d-4b53-9fab-f6ce16436ac6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:07.749744 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5dbc9773-c21d-4b53-9fab-f6ce16436ac6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:07.749744 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5dbc9773-c21d-4b53-9fab-f6ce16436ac6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:07.749744 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5dbc9773-c21d-4b53-9fab-f6ce16436ac6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:07.876637 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-5dbc9773-c21d-4b53-9fab-f6ce16436ac6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:33:07.883909 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5dbc9773-c21d-4b53-9fab-f6ce16436ac6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa" status: 200 len: 1576 microversion: 2.1 time: 0.153045 May 17 17:33:07.884467 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 452/955] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:33:07 2022] GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:33:08.903421 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-260a01f5-2d57-4089-9650-55ccf053284c tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:08.904099 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-260a01f5-2d57-4089-9650-55ccf053284c tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 350d6927-4954-47cc-9754-2f9ad827e2fa] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:08.910322 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-260a01f5-2d57-4089-9650-55ccf053284c tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:08.910777 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-260a01f5-2d57-4089-9650-55ccf053284c tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:08.911560 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-260a01f5-2d57-4089-9650-55ccf053284c tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:08.912029 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-260a01f5-2d57-4089-9650-55ccf053284c tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:09.351775 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-260a01f5-2d57-4089-9650-55ccf053284c tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:33:09.359579 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-260a01f5-2d57-4089-9650-55ccf053284c tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa" status: 200 len: 1576 microversion: 2.1 time: 0.460379 May 17 17:33:09.360130 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 504/956] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:33:08 2022] GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa => generated 1576 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:33:10.032995 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-d92cea90-8d7a-47cb-8a5a-b5080dbd9291 req-a4c3ac98-3520-473a-8a64-2b9f5abff1ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "350d6927-4954-47cc-9754-2f9ad827e2fa", "name": "network-vif-deleted", "tag": "ee4b9620-180f-492b-accb-1763e0c6c58b"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:33:10.041541 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-d92cea90-8d7a-47cb-8a5a-b5080dbd9291 req-a4c3ac98-3520-473a-8a64-2b9f5abff1ba service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:10.041985 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-d92cea90-8d7a-47cb-8a5a-b5080dbd9291 req-a4c3ac98-3520-473a-8a64-2b9f5abff1ba service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:10.052546 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-d92cea90-8d7a-47cb-8a5a-b5080dbd9291 req-a4c3ac98-3520-473a-8a64-2b9f5abff1ba service nova] Creating event network-vif-deleted:ee4b9620-180f-492b-accb-1763e0c6c58b for instance 350d6927-4954-47cc-9754-2f9ad827e2fa on hv-cinder-84214 May 17 17:33:10.057403 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-d92cea90-8d7a-47cb-8a5a-b5080dbd9291 req-a4c3ac98-3520-473a-8a64-2b9f5abff1ba service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028571 May 17 17:33:10.058130 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 453/957] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:33:10.377132 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-21e002da-804b-4942-8b7c-51a29b2b4ee3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:10.381339 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-21e002da-804b-4942-8b7c-51a29b2b4ee3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 350d6927-4954-47cc-9754-2f9ad827e2fa] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:10.384487 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-21e002da-804b-4942-8b7c-51a29b2b4ee3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:10.384935 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-21e002da-804b-4942-8b7c-51a29b2b4ee3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:10.385743 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-21e002da-804b-4942-8b7c-51a29b2b4ee3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:10.386191 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-21e002da-804b-4942-8b7c-51a29b2b4ee3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:10.451721 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-21e002da-804b-4942-8b7c-51a29b2b4ee3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:33:10.459198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-21e002da-804b-4942-8b7c-51a29b2b4ee3 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa" status: 200 len: 1225 microversion: 2.1 time: 0.086557 May 17 17:33:10.459806 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 505/958] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:33:10 2022] GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:33:11.477059 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-77f4ab8e-8bb8-41ad-a124-cdd295a4d261 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:11.477771 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-77f4ab8e-8bb8-41ad-a124-cdd295a4d261 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 350d6927-4954-47cc-9754-2f9ad827e2fa] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:11.484634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-77f4ab8e-8bb8-41ad-a124-cdd295a4d261 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:11.485080 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-77f4ab8e-8bb8-41ad-a124-cdd295a4d261 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:11.485839 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-77f4ab8e-8bb8-41ad-a124-cdd295a4d261 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:11.486273 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-77f4ab8e-8bb8-41ad-a124-cdd295a4d261 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:11.499931 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-77f4ab8e-8bb8-41ad-a124-cdd295a4d261 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] HTTP exception thrown: Instance 350d6927-4954-47cc-9754-2f9ad827e2fa could not be found. May 17 17:33:11.501547 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-77f4ab8e-8bb8-41ad-a124-cdd295a4d261 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Request method failure captured: May 17 17:33:11.501547 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa HTTP/1.1 May 17 17:33:11.501547 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:33:11.501547 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:33:11.501547 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:33:11.501547 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:33:11.501547 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:33:11.501547 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:33:11.501547 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:33:11.501547 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:33:11.501547 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9qi4Cvf0w5I4IwI8F5CML-0fzsCiCgTNNpg2cCRckAlZ6h09T33QlPj5xsec8xRGNsNuTAvdLDXwhN3kuMdlBDShah_4rbXsVK6k7QPKrvoQBkFuVgJIlWLd2h9KBC9RWh0kS4BvZUHUchdxJpDpWbFjkE0QqODMrsQjpx0LWdDtqQ May 17 17:33:11.501547 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:33:11.501547 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:33:11.501547 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:33:11.501547 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:33:11.501547 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:33:11.501547 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:33:11.501547 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: 3f5eec12182649ba98446cf774faf873 May 17 17:33:11.501547 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-TestVolumeBootPattern-1672536885 May 17 17:33:11.501547 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:33:11.501547 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:33:11.503033 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3f5eec12182649ba98446cf774faf873"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3f5eec12182649ba98446cf774faf873"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3f5eec12182649ba98446cf774faf873"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3f5eec12182649ba98446cf774faf873", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:33:11.503033 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-TestVolumeBootPattern-1672536885 May 17 17:33:11.503033 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: 3f5eec12182649ba98446cf774faf873 May 17 17:33:11.503033 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-TestVolumeBootPattern-1672536885 May 17 17:33:11.503033 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-TestVolumeBootPattern-1672536885-project May 17 17:33:11.503033 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:33:11.503033 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:33:11.503033 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 6cbe2975d6d24b4280a28056afaeb873 May 17 17:33:11.503033 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-TestVolumeBootPattern-1672536885-project May 17 17:33:11.503033 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:33:11.503033 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Instance 350d6927-4954-47cc-9754-2f9ad827e2fa could not be found. May 17 17:33:11.503033 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': '350d6927-4954-47cc-9754-2f9ad827e2fa'} May 17 17:33:11.509172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:33:11.509172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:11.509172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:33:11.509172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:33:11.509172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:33:11.509172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:33:11.509172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:33:11.509172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:33:11.509172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:33:11.509172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:33:11.509172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 350d6927-4954-47cc-9754-2f9ad827e2fa could not be found. May 17 17:33:11.509172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:11.509172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:33:11.509172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:11.509172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:11.509172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:33:11.509172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:33:11.509172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:33:11.509172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:33:11.509172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:33:11.511040 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:33:11.511040 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:33:11.511040 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:33:11.511040 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:33:11.511040 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:33:11.511040 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:33:11.511040 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:33:11.511040 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 350d6927-4954-47cc-9754-2f9ad827e2fa could not be found. May 17 17:33:11.511040 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:11.511040 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:33:11.511040 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:11.511040 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:11.511040 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:33:11.511040 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:33:11.511040 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:33:11.511040 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:33:11.511040 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 350d6927-4954-47cc-9754-2f9ad827e2fa could not be found. May 17 17:33:11.511040 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:11.512320 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-77f4ab8e-8bb8-41ad-a124-cdd295a4d261 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Returning 404 to user: Instance 350d6927-4954-47cc-9754-2f9ad827e2fa could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:33:11.512320 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-77f4ab8e-8bb8-41ad-a124-cdd295a4d261 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa" status: 404 len: 111 microversion: 2.1 time: 0.030524 May 17 17:33:11.512320 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 454/959] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:33:11 2022] GET /compute/v2.1/servers/350d6927-4954-47cc-9754-2f9ad827e2fa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:33:14.851655 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-b6b8c88f-6f1b-4e55-a42a-1557f8028def req-f3b41eff-3241-429c-8908-3f6e125ba95f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29c1b694-47cb-44ac-951e-6db2dc2437da", "tag": "2b97f078-d722-4799-b3c2-7303b516b2a3"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:33:14.859008 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c9bfd531-d6dd-4b53-a8bd-460a1a8fef92 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:14.859532 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c9bfd531-d6dd-4b53-a8bd-460a1a8fef92 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 29c1b694-47cb-44ac-951e-6db2dc2437da] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:14.866111 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c9bfd531-d6dd-4b53-a8bd-460a1a8fef92 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:14.866778 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c9bfd531-d6dd-4b53-a8bd-460a1a8fef92 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:14.866894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-b6b8c88f-6f1b-4e55-a42a-1557f8028def req-f3b41eff-3241-429c-8908-3f6e125ba95f service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:14.867321 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-b6b8c88f-6f1b-4e55-a42a-1557f8028def req-f3b41eff-3241-429c-8908-3f6e125ba95f service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:14.867825 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c9bfd531-d6dd-4b53-a8bd-460a1a8fef92 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:14.868472 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c9bfd531-d6dd-4b53-a8bd-460a1a8fef92 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:14.878567 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-b6b8c88f-6f1b-4e55-a42a-1557f8028def req-f3b41eff-3241-429c-8908-3f6e125ba95f service nova] Creating event network-changed:2b97f078-d722-4799-b3c2-7303b516b2a3 for instance 29c1b694-47cb-44ac-951e-6db2dc2437da on hv-cinder-84214 May 17 17:33:14.883537 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-b6b8c88f-6f1b-4e55-a42a-1557f8028def req-f3b41eff-3241-429c-8908-3f6e125ba95f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035422 May 17 17:33:14.884177 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 455/960] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:33:14.895122 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c9bfd531-d6dd-4b53-a8bd-460a1a8fef92 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 29c1b694-47cb-44ac-951e-6db2dc2437da] Going to try to terminate instance {{(pid=117612) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:33:15.245483 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c9bfd531-d6dd-4b53-a8bd-460a1a8fef92 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "DELETE /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da" status: 204 len: 0 microversion: 2.1 time: 0.399632 May 17 17:33:15.249302 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 506/961] 10.222.0.88 () {58 vars in 1238 bytes} [Tue May 17 17:33:14 2022] DELETE /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:33:15.255080 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-70b84ae8-c34d-4685-925f-78f101c85fa8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:15.255875 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-70b84ae8-c34d-4685-925f-78f101c85fa8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 29c1b694-47cb-44ac-951e-6db2dc2437da] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:15.262103 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-70b84ae8-c34d-4685-925f-78f101c85fa8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:15.262623 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-70b84ae8-c34d-4685-925f-78f101c85fa8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:15.264243 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-70b84ae8-c34d-4685-925f-78f101c85fa8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:15.264798 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-70b84ae8-c34d-4685-925f-78f101c85fa8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:15.403402 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-70b84ae8-c34d-4685-925f-78f101c85fa8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:33:15.412238 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-70b84ae8-c34d-4685-925f-78f101c85fa8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da" status: 200 len: 1576 microversion: 2.1 time: 0.161349 May 17 17:33:15.416182 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 456/962] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:33:15 2022] GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:33:16.429801 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-9be400e1-e094-4a76-bca7-3c9f9293d3c8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:16.430524 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-9be400e1-e094-4a76-bca7-3c9f9293d3c8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 29c1b694-47cb-44ac-951e-6db2dc2437da] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:16.437304 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9be400e1-e094-4a76-bca7-3c9f9293d3c8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:16.437743 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9be400e1-e094-4a76-bca7-3c9f9293d3c8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:16.438525 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9be400e1-e094-4a76-bca7-3c9f9293d3c8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:16.438955 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9be400e1-e094-4a76-bca7-3c9f9293d3c8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:16.612877 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-9be400e1-e094-4a76-bca7-3c9f9293d3c8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:33:16.620180 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-9be400e1-e094-4a76-bca7-3c9f9293d3c8 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da" status: 200 len: 1576 microversion: 2.1 time: 0.194538 May 17 17:33:16.621713 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 507/963] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:33:16 2022] GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da => generated 1576 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:33:17.441649 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-5f58a9dc-a4d2-4988-8ff7-83b65a7f93c2 req-c2317f86-63de-4810-9c55-7f2ed8ae4d67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29c1b694-47cb-44ac-951e-6db2dc2437da", "name": "network-vif-deleted", "tag": "2b97f078-d722-4799-b3c2-7303b516b2a3"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:33:17.449821 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-5f58a9dc-a4d2-4988-8ff7-83b65a7f93c2 req-c2317f86-63de-4810-9c55-7f2ed8ae4d67 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:17.450265 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-5f58a9dc-a4d2-4988-8ff7-83b65a7f93c2 req-c2317f86-63de-4810-9c55-7f2ed8ae4d67 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:17.460744 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-5f58a9dc-a4d2-4988-8ff7-83b65a7f93c2 req-c2317f86-63de-4810-9c55-7f2ed8ae4d67 service nova] Creating event network-vif-deleted:2b97f078-d722-4799-b3c2-7303b516b2a3 for instance 29c1b694-47cb-44ac-951e-6db2dc2437da on hv-cinder-84214 May 17 17:33:17.465420 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-5f58a9dc-a4d2-4988-8ff7-83b65a7f93c2 req-c2317f86-63de-4810-9c55-7f2ed8ae4d67 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027544 May 17 17:33:17.466035 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 457/964] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:33:17.638019 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b2722e4f-9580-4b00-b57e-e67b12214ebe tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:17.642946 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b2722e4f-9580-4b00-b57e-e67b12214ebe tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 29c1b694-47cb-44ac-951e-6db2dc2437da] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:17.645654 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b2722e4f-9580-4b00-b57e-e67b12214ebe tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:17.646113 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b2722e4f-9580-4b00-b57e-e67b12214ebe tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:17.646891 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b2722e4f-9580-4b00-b57e-e67b12214ebe tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:17.647370 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b2722e4f-9580-4b00-b57e-e67b12214ebe tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:17.713375 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b2722e4f-9580-4b00-b57e-e67b12214ebe tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbe2975d6d24b4280a28056afaeb873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5eec12182649ba98446cf774faf873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:33:17.721493 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b2722e4f-9580-4b00-b57e-e67b12214ebe tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da" status: 200 len: 1225 microversion: 2.1 time: 0.087293 May 17 17:33:17.727221 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 508/965] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:33:17 2022] GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:33:18.740865 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a7df7dcb-3281-4c72-b1ce-e96e3bd3fcc6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:18.741557 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a7df7dcb-3281-4c72-b1ce-e96e3bd3fcc6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: 29c1b694-47cb-44ac-951e-6db2dc2437da] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:18.749196 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a7df7dcb-3281-4c72-b1ce-e96e3bd3fcc6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:18.749645 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a7df7dcb-3281-4c72-b1ce-e96e3bd3fcc6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:18.750407 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a7df7dcb-3281-4c72-b1ce-e96e3bd3fcc6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:18.750842 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a7df7dcb-3281-4c72-b1ce-e96e3bd3fcc6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:18.764317 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-a7df7dcb-3281-4c72-b1ce-e96e3bd3fcc6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] HTTP exception thrown: Instance 29c1b694-47cb-44ac-951e-6db2dc2437da could not be found. May 17 17:33:18.765944 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a7df7dcb-3281-4c72-b1ce-e96e3bd3fcc6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Request method failure captured: May 17 17:33:18.765944 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da HTTP/1.1 May 17 17:33:18.765944 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:33:18.765944 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:33:18.765944 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:33:18.765944 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:33:18.765944 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:33:18.765944 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:33:18.765944 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:33:18.765944 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:33:18.765944 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9qi4Cvf0w5I4IwI8F5CML-0fzsCiCgTNNpg2cCRckAlZ6h09T33QlPj5xsec8xRGNsNuTAvdLDXwhN3kuMdlBDShah_4rbXsVK6k7QPKrvoQBkFuVgJIlWLd2h9KBC9RWh0kS4BvZUHUchdxJpDpWbFjkE0QqODMrsQjpx0LWdDtqQ May 17 17:33:18.765944 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:33:18.765944 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:33:18.765944 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:33:18.765944 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:33:18.765944 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:33:18.765944 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:33:18.765944 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: 3f5eec12182649ba98446cf774faf873 May 17 17:33:18.765944 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-TestVolumeBootPattern-1672536885 May 17 17:33:18.765944 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:33:18.765944 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:33:18.767486 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3f5eec12182649ba98446cf774faf873"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3f5eec12182649ba98446cf774faf873"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3f5eec12182649ba98446cf774faf873"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3f5eec12182649ba98446cf774faf873", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:33:18.767486 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-TestVolumeBootPattern-1672536885 May 17 17:33:18.767486 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: 3f5eec12182649ba98446cf774faf873 May 17 17:33:18.767486 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-TestVolumeBootPattern-1672536885 May 17 17:33:18.767486 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-TestVolumeBootPattern-1672536885-project May 17 17:33:18.767486 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:33:18.767486 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:33:18.767486 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 6cbe2975d6d24b4280a28056afaeb873 May 17 17:33:18.767486 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-TestVolumeBootPattern-1672536885-project May 17 17:33:18.767486 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:33:18.767486 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Instance 29c1b694-47cb-44ac-951e-6db2dc2437da could not be found. May 17 17:33:18.767486 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': '29c1b694-47cb-44ac-951e-6db2dc2437da'} May 17 17:33:18.768375 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:33:18.768375 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:18.768375 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:33:18.768375 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:33:18.768375 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:33:18.768375 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:33:18.768375 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:33:18.768375 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:33:18.768375 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:33:18.768375 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:33:18.768375 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29c1b694-47cb-44ac-951e-6db2dc2437da could not be found. May 17 17:33:18.768375 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:18.768375 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:33:18.768375 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:18.768375 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:18.768375 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:33:18.768375 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:33:18.768375 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:33:18.768375 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:33:18.768375 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:33:18.769632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:33:18.769632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:33:18.769632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:33:18.769632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:33:18.769632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:33:18.769632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:33:18.769632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:33:18.769632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29c1b694-47cb-44ac-951e-6db2dc2437da could not be found. May 17 17:33:18.769632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:18.769632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:33:18.769632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:18.769632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:18.769632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:33:18.769632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:33:18.769632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:33:18.769632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:33:18.769632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29c1b694-47cb-44ac-951e-6db2dc2437da could not be found. May 17 17:33:18.769632 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:18.770767 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a7df7dcb-3281-4c72-b1ce-e96e3bd3fcc6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Returning 404 to user: Instance 29c1b694-47cb-44ac-951e-6db2dc2437da could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:33:18.770767 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a7df7dcb-3281-4c72-b1ce-e96e3bd3fcc6 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da" status: 404 len: 111 microversion: 2.1 time: 0.032654 May 17 17:33:18.770767 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 458/966] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:33:18 2022] GET /compute/v2.1/servers/29c1b694-47cb-44ac-951e-6db2dc2437da => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:33:19.248039 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8e206d9d-8114-4ec2-8a15-b4645ad1b1a1 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:19.248555 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8e206d9d-8114-4ec2-8a15-b4645ad1b1a1 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: d8ed82ef-aec7-43db-9bc8-7f925f7e75cb] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:19.254862 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8e206d9d-8114-4ec2-8a15-b4645ad1b1a1 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:19.255306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8e206d9d-8114-4ec2-8a15-b4645ad1b1a1 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:19.256084 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8e206d9d-8114-4ec2-8a15-b4645ad1b1a1 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:19.256515 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8e206d9d-8114-4ec2-8a15-b4645ad1b1a1 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:19.269318 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-8e206d9d-8114-4ec2-8a15-b4645ad1b1a1 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] HTTP exception thrown: Instance d8ed82ef-aec7-43db-9bc8-7f925f7e75cb could not be found. May 17 17:33:19.270932 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8e206d9d-8114-4ec2-8a15-b4645ad1b1a1 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Request method failure captured: May 17 17:33:19.270932 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: request: DELETE /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb HTTP/1.1 May 17 17:33:19.270932 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 17 17:33:19.270932 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 17 17:33:19.270932 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Connection: close May 17 17:33:19.270932 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 17 17:33:19.270932 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 17 17:33:19.270932 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.88 May 17 17:33:19.270932 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 17 17:33:19.270932 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 17 17:33:19.270932 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABig9qi4Cvf0w5I4IwI8F5CML-0fzsCiCgTNNpg2cCRckAlZ6h09T33QlPj5xsec8xRGNsNuTAvdLDXwhN3kuMdlBDShah_4rbXsVK6k7QPKrvoQBkFuVgJIlWLd2h9KBC9RWh0kS4BvZUHUchdxJpDpWbFjkE0QqODMrsQjpx0LWdDtqQ May 17 17:33:19.270932 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 17 17:33:19.270932 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 17 17:33:19.270932 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 17 17:33:19.270932 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 17 17:33:19.270932 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 17 17:33:19.270932 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 17 17:33:19.270932 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 3f5eec12182649ba98446cf774faf873 May 17 17:33:19.270932 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-TestVolumeBootPattern-1672536885 May 17 17:33:19.270932 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Role: reader,member May 17 17:33:19.270932 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Roles: reader,member May 17 17:33:19.272417 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3f5eec12182649ba98446cf774faf873"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3f5eec12182649ba98446cf774faf873"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3f5eec12182649ba98446cf774faf873"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3f5eec12182649ba98446cf774faf873", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:33:19.272417 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-TestVolumeBootPattern-1672536885 May 17 17:33:19.272417 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 3f5eec12182649ba98446cf774faf873 May 17 17:33:19.272417 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-TestVolumeBootPattern-1672536885 May 17 17:33:19.272417 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User: tempest-TestVolumeBootPattern-1672536885-project May 17 17:33:19.272417 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 17 17:33:19.272417 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 17 17:33:19.272417 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Id: 6cbe2975d6d24b4280a28056afaeb873 May 17 17:33:19.272417 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-TestVolumeBootPattern-1672536885-project May 17 17:33:19.272417 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: method: > May 17 17:33:19.272417 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: exception: Instance d8ed82ef-aec7-43db-9bc8-7f925f7e75cb could not be found. May 17 17:33:19.272417 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: action_args: {'id': 'd8ed82ef-aec7-43db-9bc8-7f925f7e75cb'} May 17 17:33:19.273237 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:33:19.273237 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:19.273237 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:33:19.273237 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:33:19.273237 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:33:19.273237 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:33:19.273237 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:33:19.273237 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:33:19.273237 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:33:19.273237 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:33:19.273237 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8ed82ef-aec7-43db-9bc8-7f925f7e75cb could not be found. May 17 17:33:19.273237 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:19.273237 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:33:19.273237 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:19.273237 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:19.273237 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:33:19.273237 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:33:19.273237 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:33:19.273237 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:33:19.273237 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:33:19.274801 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:33:19.274801 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 17:33:19.274801 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 17:33:19.274801 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 17:33:19.274801 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 17:33:19.274801 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:33:19.274801 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:33:19.274801 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:33:19.274801 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:33:19.274801 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8ed82ef-aec7-43db-9bc8-7f925f7e75cb could not be found. May 17 17:33:19.274801 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:19.274801 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:33:19.274801 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:19.274801 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:19.274801 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:33:19.274801 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:33:19.274801 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:33:19.274801 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:33:19.274801 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8ed82ef-aec7-43db-9bc8-7f925f7e75cb could not be found. May 17 17:33:19.274801 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:19.276560 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8e206d9d-8114-4ec2-8a15-b4645ad1b1a1 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Returning 404 to user: Instance d8ed82ef-aec7-43db-9bc8-7f925f7e75cb could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:33:19.276560 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8e206d9d-8114-4ec2-8a15-b4645ad1b1a1 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb" status: 404 len: 111 microversion: 2.1 time: 0.028400 May 17 17:33:19.276560 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 509/967] 10.222.0.88 () {58 vars in 1238 bytes} [Tue May 17 17:33:19 2022] DELETE /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:33:19.281451 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-59c8f382-071d-4843-876c-c94dedb8f475 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:19.282061 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-59c8f382-071d-4843-876c-c94dedb8f475 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] [instance: d8ed82ef-aec7-43db-9bc8-7f925f7e75cb] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:19.287922 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-59c8f382-071d-4843-876c-c94dedb8f475 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:19.288372 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-59c8f382-071d-4843-876c-c94dedb8f475 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:19.289394 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-59c8f382-071d-4843-876c-c94dedb8f475 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:19.289829 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-59c8f382-071d-4843-876c-c94dedb8f475 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:19.304909 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-59c8f382-071d-4843-876c-c94dedb8f475 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] HTTP exception thrown: Instance d8ed82ef-aec7-43db-9bc8-7f925f7e75cb could not be found. May 17 17:33:19.306376 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-59c8f382-071d-4843-876c-c94dedb8f475 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Request method failure captured: May 17 17:33:19.306376 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb HTTP/1.1 May 17 17:33:19.306376 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:33:19.306376 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:33:19.306376 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:33:19.306376 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:33:19.306376 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:33:19.306376 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:33:19.306376 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:33:19.306376 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:33:19.306376 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9qi4Cvf0w5I4IwI8F5CML-0fzsCiCgTNNpg2cCRckAlZ6h09T33QlPj5xsec8xRGNsNuTAvdLDXwhN3kuMdlBDShah_4rbXsVK6k7QPKrvoQBkFuVgJIlWLd2h9KBC9RWh0kS4BvZUHUchdxJpDpWbFjkE0QqODMrsQjpx0LWdDtqQ May 17 17:33:19.306376 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:33:19.306376 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:33:19.306376 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:33:19.306376 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:33:19.306376 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:33:19.306376 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:33:19.306376 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: 3f5eec12182649ba98446cf774faf873 May 17 17:33:19.306376 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-TestVolumeBootPattern-1672536885 May 17 17:33:19.306376 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:33:19.306376 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:33:19.307946 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3f5eec12182649ba98446cf774faf873"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3f5eec12182649ba98446cf774faf873"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3f5eec12182649ba98446cf774faf873"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3f5eec12182649ba98446cf774faf873", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:33:19.307946 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-TestVolumeBootPattern-1672536885 May 17 17:33:19.307946 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: 3f5eec12182649ba98446cf774faf873 May 17 17:33:19.307946 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-TestVolumeBootPattern-1672536885 May 17 17:33:19.307946 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-TestVolumeBootPattern-1672536885-project May 17 17:33:19.307946 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:33:19.307946 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:33:19.307946 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 6cbe2975d6d24b4280a28056afaeb873 May 17 17:33:19.307946 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-TestVolumeBootPattern-1672536885-project May 17 17:33:19.307946 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:33:19.307946 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Instance d8ed82ef-aec7-43db-9bc8-7f925f7e75cb could not be found. May 17 17:33:19.307946 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': 'd8ed82ef-aec7-43db-9bc8-7f925f7e75cb'} May 17 17:33:19.308710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:33:19.308710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:19.308710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:33:19.308710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:33:19.308710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:33:19.308710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:33:19.308710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:33:19.308710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:33:19.308710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:33:19.308710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:33:19.308710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8ed82ef-aec7-43db-9bc8-7f925f7e75cb could not be found. May 17 17:33:19.308710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:19.308710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:33:19.308710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:19.308710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:19.308710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:33:19.308710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:33:19.308710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:33:19.308710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:33:19.308710 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:33:19.309976 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:33:19.309976 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:33:19.309976 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:33:19.309976 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:33:19.309976 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:33:19.309976 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:33:19.309976 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:33:19.309976 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8ed82ef-aec7-43db-9bc8-7f925f7e75cb could not be found. May 17 17:33:19.309976 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:19.309976 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:33:19.309976 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:19.309976 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:19.309976 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:33:19.309976 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:33:19.309976 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:33:19.309976 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:33:19.309976 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8ed82ef-aec7-43db-9bc8-7f925f7e75cb could not be found. May 17 17:33:19.309976 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:19.311137 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-59c8f382-071d-4843-876c-c94dedb8f475 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Returning 404 to user: Instance d8ed82ef-aec7-43db-9bc8-7f925f7e75cb could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:33:19.311137 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-59c8f382-071d-4843-876c-c94dedb8f475 tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb" status: 404 len: 111 microversion: 2.1 time: 0.030618 May 17 17:33:19.311137 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 459/968] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:33:19 2022] GET /compute/v2.1/servers/d8ed82ef-aec7-43db-9bc8-7f925f7e75cb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:33:20.849911 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-fcceda18-a749-4848-945e-63b7bbf9b71b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] Calling method '.version_select at 0x7f73d49c50d0>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:20.940381 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-fcceda18-a749-4848-945e-63b7bbf9b71b tempest-TestVolumeBootPattern-1672536885 tempest-TestVolumeBootPattern-1672536885-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-647335372" status: 202 len: 0 microversion: 2.1 time: 0.094248 May 17 17:33:20.940986 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 510/969] 10.222.0.88 () {58 vars in 1259 bytes} [Tue May 17 17:33:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-647335372 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:33:31.008556 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-81de897d-ab82-4d11-839f-1a18216e1cc7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:31.009134 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-81de897d-ab82-4d11-839f-1a18216e1cc7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 54c36578-fced-4088-bc46-ae0b0a74c557] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:31.015164 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-81de897d-ab82-4d11-839f-1a18216e1cc7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:31.015650 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-81de897d-ab82-4d11-839f-1a18216e1cc7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:31.016419 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-81de897d-ab82-4d11-839f-1a18216e1cc7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:31.016855 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-81de897d-ab82-4d11-839f-1a18216e1cc7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:31.039409 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-81de897d-ab82-4d11-839f-1a18216e1cc7 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557/ips" status: 200 len: 150 microversion: 2.1 time: 0.034487 May 17 17:33:31.039998 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 460/970] 10.222.0.88 () {58 vars in 1247 bytes} [Tue May 17 17:33:31 2022] GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:33:32.740363 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7a824183-641f-40ef-bffd-1195f3e01c38 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4f913cd-3029-484d-8f05-410a9ae67fb9"}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:33:32.741409 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-7a824183-641f-40ef-bffd-1195f3e01c38 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 54c36578-fced-4088-bc46-ae0b0a74c557] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:32.747941 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7a824183-641f-40ef-bffd-1195f3e01c38 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:32.748378 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7a824183-641f-40ef-bffd-1195f3e01c38 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:32.749140 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7a824183-641f-40ef-bffd-1195f3e01c38 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:32.749576 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7a824183-641f-40ef-bffd-1195f3e01c38 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:33.563437 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7a824183-641f-40ef-bffd-1195f3e01c38 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "POST /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.827510 May 17 17:33:33.564078 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 511/971] 10.222.0.88 () {60 vars in 1322 bytes} [Tue May 17 17:33:32 2022] POST /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557/os-volume_attachments => generated 194 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:33:41.119358 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5994de57-5226-49f2-8946-d167a0262a20 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:41.119865 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-5994de57-5226-49f2-8946-d167a0262a20 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 54c36578-fced-4088-bc46-ae0b0a74c557] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:41.126080 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5994de57-5226-49f2-8946-d167a0262a20 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:41.126525 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5994de57-5226-49f2-8946-d167a0262a20 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:41.127279 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5994de57-5226-49f2-8946-d167a0262a20 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:41.127748 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5994de57-5226-49f2-8946-d167a0262a20 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:41.203921 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.objects.instance [None req-5994de57-5226-49f2-8946-d167a0262a20 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lazy-loading 'services' on Instance uuid 54c36578-fced-4088-bc46-ae0b0a74c557 {{(pid=117611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:33:41.413088 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5994de57-5226-49f2-8946-d167a0262a20 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "DELETE /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557/os-volume_attachments/c4f913cd-3029-484d-8f05-410a9ae67fb9" status: 202 len: 0 microversion: 2.1 time: 0.297359 May 17 17:33:41.413673 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 461/972] 10.222.0.88 () {58 vars in 1415 bytes} [Tue May 17 17:33:41 2022] DELETE /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557/os-volume_attachments/c4f913cd-3029-484d-8f05-410a9ae67fb9 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:33:41.423397 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-98c1f328-52a5-45c5-9669-2a6a651925de tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:41.424513 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-98c1f328-52a5-45c5-9669-2a6a651925de tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 54c36578-fced-4088-bc46-ae0b0a74c557] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:41.431348 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-98c1f328-52a5-45c5-9669-2a6a651925de tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:41.431733 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-98c1f328-52a5-45c5-9669-2a6a651925de tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:41.432538 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-98c1f328-52a5-45c5-9669-2a6a651925de tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:41.432979 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-98c1f328-52a5-45c5-9669-2a6a651925de tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:41.461480 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-98c1f328-52a5-45c5-9669-2a6a651925de tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042972 May 17 17:33:41.462046 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 512/973] 10.222.0.88 () {58 vars in 1301 bytes} [Tue May 17 17:33:41 2022] GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:33:42.474496 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-23edcbc4-9749-43c8-aa23-fb3cf846a1f0 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:42.475603 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-23edcbc4-9749-43c8-aa23-fb3cf846a1f0 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 54c36578-fced-4088-bc46-ae0b0a74c557] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:42.482121 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-23edcbc4-9749-43c8-aa23-fb3cf846a1f0 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:42.482573 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-23edcbc4-9749-43c8-aa23-fb3cf846a1f0 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:42.483328 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-23edcbc4-9749-43c8-aa23-fb3cf846a1f0 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:42.483790 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-23edcbc4-9749-43c8-aa23-fb3cf846a1f0 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:42.514063 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-23edcbc4-9749-43c8-aa23-fb3cf846a1f0 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043864 May 17 17:33:42.514624 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 462/974] 10.222.0.88 () {58 vars in 1301 bytes} [Tue May 17 17:33:42 2022] GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 17:33:42.574516 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-cfee51a9-c7cc-454c-a664-115042b2c5cc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:42.575018 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-cfee51a9-c7cc-454c-a664-115042b2c5cc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 54c36578-fced-4088-bc46-ae0b0a74c557] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:42.581235 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cfee51a9-c7cc-454c-a664-115042b2c5cc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:42.581689 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cfee51a9-c7cc-454c-a664-115042b2c5cc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:42.582455 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cfee51a9-c7cc-454c-a664-115042b2c5cc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:42.582888 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cfee51a9-c7cc-454c-a664-115042b2c5cc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:42.608559 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-cfee51a9-c7cc-454c-a664-115042b2c5cc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 54c36578-fced-4088-bc46-ae0b0a74c557] Going to try to terminate instance {{(pid=117612) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:33:42.970028 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-cfee51a9-c7cc-454c-a664-115042b2c5cc tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "DELETE /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557" status: 204 len: 0 microversion: 2.1 time: 0.399030 May 17 17:33:42.970625 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 513/975] 10.222.0.88 () {58 vars in 1238 bytes} [Tue May 17 17:33:42 2022] DELETE /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:33:42.979355 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-06b3435c-fcc5-4e6d-b0c0-48eb87b8f5c5 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:42.979998 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-06b3435c-fcc5-4e6d-b0c0-48eb87b8f5c5 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 54c36578-fced-4088-bc46-ae0b0a74c557] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:42.986176 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-06b3435c-fcc5-4e6d-b0c0-48eb87b8f5c5 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:42.987233 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-06b3435c-fcc5-4e6d-b0c0-48eb87b8f5c5 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:42.988084 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-06b3435c-fcc5-4e6d-b0c0-48eb87b8f5c5 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:42.988517 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-06b3435c-fcc5-4e6d-b0c0-48eb87b8f5c5 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:43.114464 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-06b3435c-fcc5-4e6d-b0c0-48eb87b8f5c5 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:33:43.122381 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-06b3435c-fcc5-4e6d-b0c0-48eb87b8f5c5 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557" status: 200 len: 1682 microversion: 2.1 time: 0.147651 May 17 17:33:43.122948 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 463/976] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:33:42 2022] GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:33:44.140336 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-19664e99-c579-4160-a356-77e36f46a829 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:44.141034 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-19664e99-c579-4160-a356-77e36f46a829 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 54c36578-fced-4088-bc46-ae0b0a74c557] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:44.147289 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-19664e99-c579-4160-a356-77e36f46a829 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:44.147776 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-19664e99-c579-4160-a356-77e36f46a829 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:44.148546 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-19664e99-c579-4160-a356-77e36f46a829 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:44.148981 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-19664e99-c579-4160-a356-77e36f46a829 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:44.273198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-19664e99-c579-4160-a356-77e36f46a829 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:33:44.280419 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-19664e99-c579-4160-a356-77e36f46a829 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557" status: 200 len: 1682 microversion: 2.1 time: 0.144252 May 17 17:33:44.280972 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 514/977] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:33:44 2022] GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557 => generated 1682 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:33:45.298391 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e1f741ff-2dc7-4bd2-b0cb-1f2e807fec4f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:45.298984 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e1f741ff-2dc7-4bd2-b0cb-1f2e807fec4f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 54c36578-fced-4088-bc46-ae0b0a74c557] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:45.305166 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e1f741ff-2dc7-4bd2-b0cb-1f2e807fec4f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:45.305583 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e1f741ff-2dc7-4bd2-b0cb-1f2e807fec4f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:45.306344 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e1f741ff-2dc7-4bd2-b0cb-1f2e807fec4f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:45.306779 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e1f741ff-2dc7-4bd2-b0cb-1f2e807fec4f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:45.518465 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e1f741ff-2dc7-4bd2-b0cb-1f2e807fec4f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:33:45.526326 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e1f741ff-2dc7-4bd2-b0cb-1f2e807fec4f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557" status: 200 len: 1682 microversion: 2.1 time: 0.231301 May 17 17:33:45.526882 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 464/978] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:33:45 2022] GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557 => generated 1682 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:33:45.723254 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-52fa6861-ca4b-4885-b6d3-dcd0257ee9d5 req-192ae945-cec2-4cb5-af69-63cdc62c1e8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c36578-fced-4088-bc46-ae0b0a74c557", "name": "network-vif-deleted", "tag": "1305375d-3df8-44bb-ab56-796b91f737c1"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:33:45.732804 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-52fa6861-ca4b-4885-b6d3-dcd0257ee9d5 req-192ae945-cec2-4cb5-af69-63cdc62c1e8d service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:45.744948 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-52fa6861-ca4b-4885-b6d3-dcd0257ee9d5 req-192ae945-cec2-4cb5-af69-63cdc62c1e8d service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:45.744948 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-52fa6861-ca4b-4885-b6d3-dcd0257ee9d5 req-192ae945-cec2-4cb5-af69-63cdc62c1e8d service nova] Creating event network-vif-deleted:1305375d-3df8-44bb-ab56-796b91f737c1 for instance 54c36578-fced-4088-bc46-ae0b0a74c557 on hv-cinder-84214 May 17 17:33:45.749469 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-52fa6861-ca4b-4885-b6d3-dcd0257ee9d5 req-192ae945-cec2-4cb5-af69-63cdc62c1e8d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029921 May 17 17:33:45.750050 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 515/979] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:33:46.544508 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e1d30bc1-0ab5-4701-b7bb-260c1c74db3b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:46.549505 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e1d30bc1-0ab5-4701-b7bb-260c1c74db3b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 54c36578-fced-4088-bc46-ae0b0a74c557] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:46.552367 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e1d30bc1-0ab5-4701-b7bb-260c1c74db3b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:46.552810 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e1d30bc1-0ab5-4701-b7bb-260c1c74db3b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:46.553723 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e1d30bc1-0ab5-4701-b7bb-260c1c74db3b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:46.554161 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e1d30bc1-0ab5-4701-b7bb-260c1c74db3b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:46.586998 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e1d30bc1-0ab5-4701-b7bb-260c1c74db3b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:46.589671 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e1d30bc1-0ab5-4701-b7bb-260c1c74db3b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:46.589671 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.objects.instance [None req-e1d30bc1-0ab5-4701-b7bb-260c1c74db3b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lazy-loading 'fault' on Instance uuid 54c36578-fced-4088-bc46-ae0b0a74c557 {{(pid=117611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:33:46.633144 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e1d30bc1-0ab5-4701-b7bb-260c1c74db3b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22bf1b41774f64b7a380d86ef3f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b8b6a551347b6a920e4cfb59b9480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:33:46.640786 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e1d30bc1-0ab5-4701-b7bb-260c1c74db3b tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557" status: 200 len: 1331 microversion: 2.1 time: 0.100730 May 17 17:33:46.641362 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 465/980] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:33:46 2022] GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557 => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:33:47.658696 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ebf2a189-db24-4210-a11d-44b073b52c37 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:47.659385 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ebf2a189-db24-4210-a11d-44b073b52c37 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 54c36578-fced-4088-bc46-ae0b0a74c557] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:47.665749 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ebf2a189-db24-4210-a11d-44b073b52c37 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:47.666200 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ebf2a189-db24-4210-a11d-44b073b52c37 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:47.666959 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ebf2a189-db24-4210-a11d-44b073b52c37 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:47.667387 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ebf2a189-db24-4210-a11d-44b073b52c37 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:47.680140 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-ebf2a189-db24-4210-a11d-44b073b52c37 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] HTTP exception thrown: Instance 54c36578-fced-4088-bc46-ae0b0a74c557 could not be found. May 17 17:33:47.682674 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ebf2a189-db24-4210-a11d-44b073b52c37 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Request method failure captured: May 17 17:33:47.682674 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: request: GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557 HTTP/1.1 May 17 17:33:47.682674 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 17 17:33:47.682674 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 17 17:33:47.682674 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Connection: close May 17 17:33:47.682674 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 17 17:33:47.682674 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 17 17:33:47.682674 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.88 May 17 17:33:47.682674 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 17 17:33:47.682674 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 17 17:33:47.682674 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABig9tWg17ELpg_TTkWzbFxHdaAAQsss46MNpXjEEnfH7yXijN80XDWmxF0PUmXoUksbJKowpEVVnYtBVvoWuiL6GXCGYlSppsHPRNYd8MeFV0B2bmGGuVwLt685v1qI8gbaO7aXhyrZ0FembuKv9KvgsXW4ySi9m_Wz_eukMKqtMUcZBY May 17 17:33:47.682674 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 17 17:33:47.682674 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 17 17:33:47.682674 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 17 17:33:47.682674 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 17 17:33:47.682674 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 17 17:33:47.682674 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 17 17:33:47.682674 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Id: ed4b8b6a551347b6a920e4cfb59b9480 May 17 17:33:47.682674 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:33:47.682674 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Role: reader,member May 17 17:33:47.682674 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Roles: reader,member May 17 17:33:47.684404 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ed4b8b6a551347b6a920e4cfb59b9480", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:33:47.684404 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:33:47.684404 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: ed4b8b6a551347b6a920e4cfb59b9480 May 17 17:33:47.684404 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:33:47.684404 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeNegativeTest-1113418987-project May 17 17:33:47.684404 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 17 17:33:47.684404 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 17 17:33:47.684404 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Id: 7b22bf1b41774f64b7a380d86ef3f72e May 17 17:33:47.684404 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeNegativeTest-1113418987-project May 17 17:33:47.684404 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: method: > May 17 17:33:47.684404 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: exception: Instance 54c36578-fced-4088-bc46-ae0b0a74c557 could not be found. May 17 17:33:47.684404 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: action_args: {'id': '54c36578-fced-4088-bc46-ae0b0a74c557'} May 17 17:33:47.685421 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:33:47.685421 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:47.685421 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:33:47.685421 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:33:47.685421 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:33:47.685421 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:33:47.685421 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:33:47.685421 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:33:47.685421 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:33:47.685421 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:33:47.685421 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54c36578-fced-4088-bc46-ae0b0a74c557 could not be found. May 17 17:33:47.685421 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:47.685421 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:33:47.685421 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:47.685421 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:47.685421 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:33:47.685421 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:33:47.685421 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:33:47.685421 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:33:47.685421 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:33:47.687064 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:33:47.687064 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:33:47.687064 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:33:47.687064 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:33:47.687064 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:33:47.687064 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:33:47.687064 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:33:47.687064 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54c36578-fced-4088-bc46-ae0b0a74c557 could not be found. May 17 17:33:47.687064 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:47.687064 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:33:47.687064 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:47.687064 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:47.687064 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:33:47.687064 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:33:47.687064 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:33:47.687064 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:33:47.687064 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54c36578-fced-4088-bc46-ae0b0a74c557 could not be found. May 17 17:33:47.687064 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:47.688582 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ebf2a189-db24-4210-a11d-44b073b52c37 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Returning 404 to user: Instance 54c36578-fced-4088-bc46-ae0b0a74c557 could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:33:47.688582 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ebf2a189-db24-4210-a11d-44b073b52c37 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557" status: 404 len: 111 microversion: 2.1 time: 0.029508 May 17 17:33:47.688582 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 516/981] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:33:47 2022] GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:33:47.692243 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-44338baa-a830-40a3-8bbf-d0dcceba5288 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '.version_select at 0x7f73d4a53e50>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:47.808965 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-44338baa-a830-40a3-8bbf-d0dcceba5288 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-325261136" status: 202 len: 0 microversion: 2.1 time: 0.120341 May 17 17:33:47.809537 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 466/982] 10.222.0.88 () {58 vars in 1217 bytes} [Tue May 17 17:33:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-325261136 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 17 17:33:49.875378 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e9b862b8-74bb-46f5-89dd-bf76903903e1 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:49.875860 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e9b862b8-74bb-46f5-89dd-bf76903903e1 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 54c36578-fced-4088-bc46-ae0b0a74c557] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:49.882067 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e9b862b8-74bb-46f5-89dd-bf76903903e1 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:49.882512 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e9b862b8-74bb-46f5-89dd-bf76903903e1 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:49.883273 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e9b862b8-74bb-46f5-89dd-bf76903903e1 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:49.883742 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e9b862b8-74bb-46f5-89dd-bf76903903e1 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:49.896631 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-e9b862b8-74bb-46f5-89dd-bf76903903e1 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] HTTP exception thrown: Instance 54c36578-fced-4088-bc46-ae0b0a74c557 could not be found. May 17 17:33:49.898125 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e9b862b8-74bb-46f5-89dd-bf76903903e1 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Request method failure captured: May 17 17:33:49.898125 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: request: DELETE /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557 HTTP/1.1 May 17 17:33:49.898125 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 17 17:33:49.898125 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 17 17:33:49.898125 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Connection: close May 17 17:33:49.898125 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 17 17:33:49.898125 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 17 17:33:49.898125 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.88 May 17 17:33:49.898125 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 17 17:33:49.898125 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 17 17:33:49.898125 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABig9tWg17ELpg_TTkWzbFxHdaAAQsss46MNpXjEEnfH7yXijN80XDWmxF0PUmXoUksbJKowpEVVnYtBVvoWuiL6GXCGYlSppsHPRNYd8MeFV0B2bmGGuVwLt685v1qI8gbaO7aXhyrZ0FembuKv9KvgsXW4ySi9m_Wz_eukMKqtMUcZBY May 17 17:33:49.898125 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 17 17:33:49.898125 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 17 17:33:49.898125 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 17 17:33:49.898125 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 17 17:33:49.898125 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 17 17:33:49.898125 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 17 17:33:49.898125 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Id: ed4b8b6a551347b6a920e4cfb59b9480 May 17 17:33:49.898125 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:33:49.898125 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Role: reader,member May 17 17:33:49.898125 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Roles: reader,member May 17 17:33:49.899800 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ed4b8b6a551347b6a920e4cfb59b9480", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:33:49.899800 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:33:49.899800 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: ed4b8b6a551347b6a920e4cfb59b9480 May 17 17:33:49.899800 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:33:49.899800 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeNegativeTest-1113418987-project May 17 17:33:49.899800 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 17 17:33:49.899800 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 17 17:33:49.899800 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Id: 7b22bf1b41774f64b7a380d86ef3f72e May 17 17:33:49.899800 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeNegativeTest-1113418987-project May 17 17:33:49.899800 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: method: > May 17 17:33:49.899800 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: exception: Instance 54c36578-fced-4088-bc46-ae0b0a74c557 could not be found. May 17 17:33:49.899800 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: action_args: {'id': '54c36578-fced-4088-bc46-ae0b0a74c557'} May 17 17:33:49.900803 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:33:49.900803 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:49.900803 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:33:49.900803 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:33:49.900803 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:33:49.900803 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:33:49.900803 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:33:49.900803 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:33:49.900803 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:33:49.900803 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:33:49.900803 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54c36578-fced-4088-bc46-ae0b0a74c557 could not be found. May 17 17:33:49.900803 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:49.900803 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:33:49.900803 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:49.900803 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:49.900803 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:33:49.900803 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:33:49.900803 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:33:49.900803 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:33:49.900803 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:33:49.902123 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:33:49.902123 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 17:33:49.902123 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 17:33:49.902123 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 17:33:49.902123 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 17:33:49.902123 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:33:49.902123 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:33:49.902123 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:33:49.902123 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:33:49.902123 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54c36578-fced-4088-bc46-ae0b0a74c557 could not be found. May 17 17:33:49.902123 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:49.902123 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:33:49.902123 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:49.902123 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:49.902123 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:33:49.902123 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:33:49.902123 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:33:49.902123 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:33:49.902123 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54c36578-fced-4088-bc46-ae0b0a74c557 could not be found. May 17 17:33:49.902123 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:49.904128 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e9b862b8-74bb-46f5-89dd-bf76903903e1 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Returning 404 to user: Instance 54c36578-fced-4088-bc46-ae0b0a74c557 could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:33:49.904128 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e9b862b8-74bb-46f5-89dd-bf76903903e1 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "DELETE /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557" status: 404 len: 111 microversion: 2.1 time: 0.027999 May 17 17:33:49.904128 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 517/983] 10.222.0.88 () {58 vars in 1238 bytes} [Tue May 17 17:33:49 2022] DELETE /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:33:49.909728 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5884439f-4950-46b0-ba4c-3b89792e0274 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:49.910330 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-5884439f-4950-46b0-ba4c-3b89792e0274 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 54c36578-fced-4088-bc46-ae0b0a74c557] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:49.917117 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5884439f-4950-46b0-ba4c-3b89792e0274 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:49.917562 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5884439f-4950-46b0-ba4c-3b89792e0274 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:49.918323 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5884439f-4950-46b0-ba4c-3b89792e0274 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:49.919391 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5884439f-4950-46b0-ba4c-3b89792e0274 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:49.932050 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-5884439f-4950-46b0-ba4c-3b89792e0274 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] HTTP exception thrown: Instance 54c36578-fced-4088-bc46-ae0b0a74c557 could not be found. May 17 17:33:49.933634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5884439f-4950-46b0-ba4c-3b89792e0274 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Request method failure captured: May 17 17:33:49.933634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557 HTTP/1.1 May 17 17:33:49.933634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:33:49.933634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:33:49.933634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:33:49.933634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:33:49.933634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:33:49.933634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:33:49.933634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:33:49.933634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:33:49.933634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9tWg17ELpg_TTkWzbFxHdaAAQsss46MNpXjEEnfH7yXijN80XDWmxF0PUmXoUksbJKowpEVVnYtBVvoWuiL6GXCGYlSppsHPRNYd8MeFV0B2bmGGuVwLt685v1qI8gbaO7aXhyrZ0FembuKv9KvgsXW4ySi9m_Wz_eukMKqtMUcZBY May 17 17:33:49.933634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:33:49.933634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:33:49.933634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:33:49.933634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:33:49.933634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:33:49.933634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:33:49.933634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: ed4b8b6a551347b6a920e4cfb59b9480 May 17 17:33:49.933634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:33:49.933634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:33:49.933634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:33:49.935218 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ed4b8b6a551347b6a920e4cfb59b9480", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:33:49.935218 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:33:49.935218 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: ed4b8b6a551347b6a920e4cfb59b9480 May 17 17:33:49.935218 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:33:49.935218 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-AttachVolumeNegativeTest-1113418987-project May 17 17:33:49.935218 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:33:49.935218 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:33:49.935218 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 7b22bf1b41774f64b7a380d86ef3f72e May 17 17:33:49.935218 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-AttachVolumeNegativeTest-1113418987-project May 17 17:33:49.935218 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:33:49.935218 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Instance 54c36578-fced-4088-bc46-ae0b0a74c557 could not be found. May 17 17:33:49.935218 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': '54c36578-fced-4088-bc46-ae0b0a74c557'} May 17 17:33:49.936185 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:33:49.936185 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:49.936185 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:33:49.936185 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:33:49.936185 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:33:49.936185 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:33:49.936185 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:33:49.936185 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:33:49.936185 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:33:49.936185 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:33:49.936185 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54c36578-fced-4088-bc46-ae0b0a74c557 could not be found. May 17 17:33:49.936185 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:49.936185 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:33:49.936185 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:49.936185 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:49.936185 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:33:49.936185 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:33:49.936185 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:33:49.936185 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:33:49.936185 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:33:49.937754 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:33:49.937754 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:33:49.937754 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:33:49.937754 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:33:49.937754 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:33:49.937754 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:33:49.937754 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:33:49.937754 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54c36578-fced-4088-bc46-ae0b0a74c557 could not be found. May 17 17:33:49.937754 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:49.937754 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:33:49.937754 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:49.937754 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:49.937754 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:33:49.937754 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:33:49.937754 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:33:49.937754 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:33:49.937754 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54c36578-fced-4088-bc46-ae0b0a74c557 could not be found. May 17 17:33:49.937754 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:49.939187 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5884439f-4950-46b0-ba4c-3b89792e0274 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Returning 404 to user: Instance 54c36578-fced-4088-bc46-ae0b0a74c557 could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:33:49.939187 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5884439f-4950-46b0-ba4c-3b89792e0274 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557" status: 404 len: 111 microversion: 2.1 time: 0.029554 May 17 17:33:49.939187 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 467/984] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:33:49 2022] GET /compute/v2.1/servers/54c36578-fced-4088-bc46-ae0b0a74c557 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:33:51.248715 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8db7e389-8ad1-4cd0-9427-8a3d8e56eb33 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:51.249195 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8db7e389-8ad1-4cd0-9427-8a3d8e56eb33 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 62f54293-2cef-4912-b3e4-1dfa60ca079a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:51.255428 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8db7e389-8ad1-4cd0-9427-8a3d8e56eb33 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:51.255913 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8db7e389-8ad1-4cd0-9427-8a3d8e56eb33 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:51.256682 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8db7e389-8ad1-4cd0-9427-8a3d8e56eb33 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:51.257115 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8db7e389-8ad1-4cd0-9427-8a3d8e56eb33 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:51.270004 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-8db7e389-8ad1-4cd0-9427-8a3d8e56eb33 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] HTTP exception thrown: Instance 62f54293-2cef-4912-b3e4-1dfa60ca079a could not be found. May 17 17:33:51.271547 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8db7e389-8ad1-4cd0-9427-8a3d8e56eb33 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Request method failure captured: May 17 17:33:51.271547 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: request: DELETE /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a HTTP/1.1 May 17 17:33:51.271547 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 17 17:33:51.271547 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 17 17:33:51.271547 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Connection: close May 17 17:33:51.271547 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 17 17:33:51.271547 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 17 17:33:51.271547 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.88 May 17 17:33:51.271547 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 17 17:33:51.271547 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 17 17:33:51.271547 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABig9tWg17ELpg_TTkWzbFxHdaAAQsss46MNpXjEEnfH7yXijN80XDWmxF0PUmXoUksbJKowpEVVnYtBVvoWuiL6GXCGYlSppsHPRNYd8MeFV0B2bmGGuVwLt685v1qI8gbaO7aXhyrZ0FembuKv9KvgsXW4ySi9m_Wz_eukMKqtMUcZBY May 17 17:33:51.271547 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 17 17:33:51.271547 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 17 17:33:51.271547 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 17 17:33:51.271547 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 17 17:33:51.271547 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 17 17:33:51.271547 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 17 17:33:51.271547 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Id: ed4b8b6a551347b6a920e4cfb59b9480 May 17 17:33:51.271547 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:33:51.271547 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Role: reader,member May 17 17:33:51.271547 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Roles: reader,member May 17 17:33:51.273052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ed4b8b6a551347b6a920e4cfb59b9480", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:33:51.273052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:33:51.273052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: ed4b8b6a551347b6a920e4cfb59b9480 May 17 17:33:51.273052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:33:51.273052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeNegativeTest-1113418987-project May 17 17:33:51.273052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 17 17:33:51.273052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 17 17:33:51.273052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Id: 7b22bf1b41774f64b7a380d86ef3f72e May 17 17:33:51.273052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeNegativeTest-1113418987-project May 17 17:33:51.273052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: method: > May 17 17:33:51.273052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: exception: Instance 62f54293-2cef-4912-b3e4-1dfa60ca079a could not be found. May 17 17:33:51.273052 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: action_args: {'id': '62f54293-2cef-4912-b3e4-1dfa60ca079a'} May 17 17:33:51.274112 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:33:51.274112 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:51.274112 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:33:51.274112 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:33:51.274112 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:33:51.274112 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:33:51.274112 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:33:51.274112 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:33:51.274112 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:33:51.274112 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:33:51.274112 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62f54293-2cef-4912-b3e4-1dfa60ca079a could not be found. May 17 17:33:51.274112 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:51.274112 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:33:51.274112 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:51.274112 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:51.274112 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:33:51.274112 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:33:51.274112 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:33:51.274112 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:33:51.274112 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:33:51.275730 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:33:51.275730 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 17:33:51.275730 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 17:33:51.275730 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 17:33:51.275730 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 17:33:51.275730 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:33:51.275730 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:33:51.275730 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:33:51.275730 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:33:51.275730 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62f54293-2cef-4912-b3e4-1dfa60ca079a could not be found. May 17 17:33:51.275730 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:51.275730 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:33:51.275730 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:51.275730 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:51.275730 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:33:51.275730 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:33:51.275730 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:33:51.275730 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:33:51.275730 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62f54293-2cef-4912-b3e4-1dfa60ca079a could not be found. May 17 17:33:51.275730 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:51.277446 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8db7e389-8ad1-4cd0-9427-8a3d8e56eb33 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Returning 404 to user: Instance 62f54293-2cef-4912-b3e4-1dfa60ca079a could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:33:51.277446 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8db7e389-8ad1-4cd0-9427-8a3d8e56eb33 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "DELETE /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a" status: 404 len: 111 microversion: 2.1 time: 0.028590 May 17 17:33:51.277446 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 518/985] 10.222.0.88 () {58 vars in 1238 bytes} [Tue May 17 17:33:51 2022] DELETE /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:33:51.280960 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ba2cb1f5-5a6b-476e-8236-411d6a6b756f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:51.281574 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ba2cb1f5-5a6b-476e-8236-411d6a6b756f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: 62f54293-2cef-4912-b3e4-1dfa60ca079a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:51.287912 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ba2cb1f5-5a6b-476e-8236-411d6a6b756f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:51.288361 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ba2cb1f5-5a6b-476e-8236-411d6a6b756f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:51.289378 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ba2cb1f5-5a6b-476e-8236-411d6a6b756f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:51.289814 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ba2cb1f5-5a6b-476e-8236-411d6a6b756f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:51.304538 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-ba2cb1f5-5a6b-476e-8236-411d6a6b756f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] HTTP exception thrown: Instance 62f54293-2cef-4912-b3e4-1dfa60ca079a could not be found. May 17 17:33:51.305996 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ba2cb1f5-5a6b-476e-8236-411d6a6b756f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Request method failure captured: May 17 17:33:51.305996 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a HTTP/1.1 May 17 17:33:51.305996 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:33:51.305996 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:33:51.305996 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:33:51.305996 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:33:51.305996 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:33:51.305996 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:33:51.305996 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:33:51.305996 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:33:51.305996 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9tWg17ELpg_TTkWzbFxHdaAAQsss46MNpXjEEnfH7yXijN80XDWmxF0PUmXoUksbJKowpEVVnYtBVvoWuiL6GXCGYlSppsHPRNYd8MeFV0B2bmGGuVwLt685v1qI8gbaO7aXhyrZ0FembuKv9KvgsXW4ySi9m_Wz_eukMKqtMUcZBY May 17 17:33:51.305996 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:33:51.305996 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:33:51.305996 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:33:51.305996 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:33:51.305996 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:33:51.305996 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:33:51.305996 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: ed4b8b6a551347b6a920e4cfb59b9480 May 17 17:33:51.305996 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:33:51.305996 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:33:51.305996 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:33:51.307773 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ed4b8b6a551347b6a920e4cfb59b9480", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:33:51.307773 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:33:51.307773 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: ed4b8b6a551347b6a920e4cfb59b9480 May 17 17:33:51.307773 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:33:51.307773 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-AttachVolumeNegativeTest-1113418987-project May 17 17:33:51.307773 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:33:51.307773 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:33:51.307773 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 7b22bf1b41774f64b7a380d86ef3f72e May 17 17:33:51.307773 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-AttachVolumeNegativeTest-1113418987-project May 17 17:33:51.307773 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:33:51.307773 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Instance 62f54293-2cef-4912-b3e4-1dfa60ca079a could not be found. May 17 17:33:51.307773 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': '62f54293-2cef-4912-b3e4-1dfa60ca079a'} May 17 17:33:51.308848 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:33:51.308848 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:51.308848 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:33:51.308848 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:33:51.308848 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:33:51.308848 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:33:51.308848 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:33:51.308848 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:33:51.308848 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:33:51.308848 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:33:51.308848 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62f54293-2cef-4912-b3e4-1dfa60ca079a could not be found. May 17 17:33:51.308848 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:51.308848 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:33:51.308848 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:51.308848 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:51.308848 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:33:51.308848 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:33:51.308848 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:33:51.308848 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:33:51.308848 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:33:51.311051 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:33:51.311051 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:33:51.311051 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:33:51.311051 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:33:51.311051 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:33:51.311051 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:33:51.311051 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:33:51.311051 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62f54293-2cef-4912-b3e4-1dfa60ca079a could not be found. May 17 17:33:51.311051 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:51.311051 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:33:51.311051 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:51.311051 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:51.311051 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:33:51.311051 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:33:51.311051 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:33:51.311051 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:33:51.311051 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62f54293-2cef-4912-b3e4-1dfa60ca079a could not be found. May 17 17:33:51.311051 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:51.312421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ba2cb1f5-5a6b-476e-8236-411d6a6b756f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Returning 404 to user: Instance 62f54293-2cef-4912-b3e4-1dfa60ca079a could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:33:51.312421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ba2cb1f5-5a6b-476e-8236-411d6a6b756f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a" status: 404 len: 111 microversion: 2.1 time: 0.030148 May 17 17:33:51.312421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 468/986] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:33:51 2022] GET /compute/v2.1/servers/62f54293-2cef-4912-b3e4-1dfa60ca079a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 17:33:51.316049 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-01e8d5a7-fe49-4b10-9f81-7ac6ac0d83a0 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:51.316578 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-01e8d5a7-fe49-4b10-9f81-7ac6ac0d83a0 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ecb716a9-d5f9-485a-85ce-4e9eb0e8292e] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:51.322372 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-01e8d5a7-fe49-4b10-9f81-7ac6ac0d83a0 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:51.322820 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-01e8d5a7-fe49-4b10-9f81-7ac6ac0d83a0 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:51.323608 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-01e8d5a7-fe49-4b10-9f81-7ac6ac0d83a0 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:51.324041 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-01e8d5a7-fe49-4b10-9f81-7ac6ac0d83a0 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:51.336793 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-01e8d5a7-fe49-4b10-9f81-7ac6ac0d83a0 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] HTTP exception thrown: Instance ecb716a9-d5f9-485a-85ce-4e9eb0e8292e could not be found. May 17 17:33:51.338290 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-01e8d5a7-fe49-4b10-9f81-7ac6ac0d83a0 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Request method failure captured: May 17 17:33:51.338290 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: request: DELETE /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e HTTP/1.1 May 17 17:33:51.338290 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 17 17:33:51.338290 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 17 17:33:51.338290 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Connection: close May 17 17:33:51.338290 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 17 17:33:51.338290 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 17 17:33:51.338290 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.88 May 17 17:33:51.338290 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 17 17:33:51.338290 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 17 17:33:51.338290 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABig9tWg17ELpg_TTkWzbFxHdaAAQsss46MNpXjEEnfH7yXijN80XDWmxF0PUmXoUksbJKowpEVVnYtBVvoWuiL6GXCGYlSppsHPRNYd8MeFV0B2bmGGuVwLt685v1qI8gbaO7aXhyrZ0FembuKv9KvgsXW4ySi9m_Wz_eukMKqtMUcZBY May 17 17:33:51.338290 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 17 17:33:51.338290 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 17 17:33:51.338290 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 17 17:33:51.338290 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 17 17:33:51.338290 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 17 17:33:51.338290 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 17 17:33:51.338290 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Id: ed4b8b6a551347b6a920e4cfb59b9480 May 17 17:33:51.338290 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:33:51.338290 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Role: reader,member May 17 17:33:51.338290 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Roles: reader,member May 17 17:33:51.339949 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ed4b8b6a551347b6a920e4cfb59b9480", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:33:51.339949 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:33:51.339949 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: ed4b8b6a551347b6a920e4cfb59b9480 May 17 17:33:51.339949 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:33:51.339949 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeNegativeTest-1113418987-project May 17 17:33:51.339949 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 17 17:33:51.339949 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 17 17:33:51.339949 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Id: 7b22bf1b41774f64b7a380d86ef3f72e May 17 17:33:51.339949 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeNegativeTest-1113418987-project May 17 17:33:51.339949 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: method: > May 17 17:33:51.339949 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: exception: Instance ecb716a9-d5f9-485a-85ce-4e9eb0e8292e could not be found. May 17 17:33:51.339949 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: action_args: {'id': 'ecb716a9-d5f9-485a-85ce-4e9eb0e8292e'} May 17 17:33:51.341611 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:33:51.341611 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:51.341611 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:33:51.341611 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:33:51.341611 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:33:51.341611 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:33:51.341611 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:33:51.341611 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:33:51.341611 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:33:51.341611 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:33:51.341611 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecb716a9-d5f9-485a-85ce-4e9eb0e8292e could not be found. May 17 17:33:51.341611 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:51.341611 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:33:51.341611 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:51.341611 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:51.341611 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:33:51.341611 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:33:51.341611 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:33:51.341611 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:33:51.341611 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:33:51.343255 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:33:51.343255 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 17:33:51.343255 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 17:33:51.343255 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 17:33:51.343255 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 17:33:51.343255 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:33:51.343255 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:33:51.343255 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:33:51.343255 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:33:51.343255 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecb716a9-d5f9-485a-85ce-4e9eb0e8292e could not be found. May 17 17:33:51.343255 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:51.343255 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:33:51.343255 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:51.343255 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:51.343255 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:33:51.343255 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:33:51.343255 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:33:51.343255 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:33:51.343255 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecb716a9-d5f9-485a-85ce-4e9eb0e8292e could not be found. May 17 17:33:51.343255 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:51.344941 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-01e8d5a7-fe49-4b10-9f81-7ac6ac0d83a0 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Returning 404 to user: Instance ecb716a9-d5f9-485a-85ce-4e9eb0e8292e could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:33:51.344941 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-01e8d5a7-fe49-4b10-9f81-7ac6ac0d83a0 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "DELETE /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e" status: 404 len: 111 microversion: 2.1 time: 0.027318 May 17 17:33:51.344941 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 519/987] 10.222.0.88 () {58 vars in 1238 bytes} [Tue May 17 17:33:51 2022] DELETE /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:33:51.348063 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7a33171e-6dcc-40be-a4ff-387b1e54e3e8 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:51.348672 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-7a33171e-6dcc-40be-a4ff-387b1e54e3e8 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ecb716a9-d5f9-485a-85ce-4e9eb0e8292e] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:51.354438 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7a33171e-6dcc-40be-a4ff-387b1e54e3e8 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:51.354883 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7a33171e-6dcc-40be-a4ff-387b1e54e3e8 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:51.355677 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7a33171e-6dcc-40be-a4ff-387b1e54e3e8 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:51.356131 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7a33171e-6dcc-40be-a4ff-387b1e54e3e8 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:51.524599 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-7a33171e-6dcc-40be-a4ff-387b1e54e3e8 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] HTTP exception thrown: Instance ecb716a9-d5f9-485a-85ce-4e9eb0e8292e could not be found. May 17 17:33:51.526021 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7a33171e-6dcc-40be-a4ff-387b1e54e3e8 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Request method failure captured: May 17 17:33:51.526021 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e HTTP/1.1 May 17 17:33:51.526021 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:33:51.526021 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:33:51.526021 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:33:51.526021 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:33:51.526021 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:33:51.526021 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:33:51.526021 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:33:51.526021 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:33:51.526021 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9tWg17ELpg_TTkWzbFxHdaAAQsss46MNpXjEEnfH7yXijN80XDWmxF0PUmXoUksbJKowpEVVnYtBVvoWuiL6GXCGYlSppsHPRNYd8MeFV0B2bmGGuVwLt685v1qI8gbaO7aXhyrZ0FembuKv9KvgsXW4ySi9m_Wz_eukMKqtMUcZBY May 17 17:33:51.526021 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:33:51.526021 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:33:51.526021 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:33:51.526021 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:33:51.526021 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:33:51.526021 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:33:51.526021 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: ed4b8b6a551347b6a920e4cfb59b9480 May 17 17:33:51.526021 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:33:51.526021 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:33:51.526021 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:33:51.527736 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ed4b8b6a551347b6a920e4cfb59b9480", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:33:51.527736 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:33:51.527736 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: ed4b8b6a551347b6a920e4cfb59b9480 May 17 17:33:51.527736 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:33:51.527736 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-AttachVolumeNegativeTest-1113418987-project May 17 17:33:51.527736 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:33:51.527736 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:33:51.527736 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 7b22bf1b41774f64b7a380d86ef3f72e May 17 17:33:51.527736 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-AttachVolumeNegativeTest-1113418987-project May 17 17:33:51.527736 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:33:51.527736 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Instance ecb716a9-d5f9-485a-85ce-4e9eb0e8292e could not be found. May 17 17:33:51.527736 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': 'ecb716a9-d5f9-485a-85ce-4e9eb0e8292e'} May 17 17:33:51.529259 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:33:51.529259 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:51.529259 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:33:51.529259 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:33:51.529259 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:33:51.529259 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:33:51.529259 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:33:51.529259 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:33:51.529259 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:33:51.529259 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:33:51.529259 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecb716a9-d5f9-485a-85ce-4e9eb0e8292e could not be found. May 17 17:33:51.529259 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:51.529259 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:33:51.529259 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:51.529259 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:51.529259 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:33:51.529259 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:33:51.529259 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:33:51.529259 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:33:51.529259 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:33:51.530802 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:33:51.530802 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:33:51.530802 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:33:51.530802 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:33:51.530802 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:33:51.530802 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:33:51.530802 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:33:51.530802 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecb716a9-d5f9-485a-85ce-4e9eb0e8292e could not be found. May 17 17:33:51.530802 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:51.530802 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:33:51.530802 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:51.530802 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:51.530802 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:33:51.530802 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:33:51.530802 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:33:51.530802 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:33:51.530802 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecb716a9-d5f9-485a-85ce-4e9eb0e8292e could not be found. May 17 17:33:51.530802 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:51.532323 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7a33171e-6dcc-40be-a4ff-387b1e54e3e8 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Returning 404 to user: Instance ecb716a9-d5f9-485a-85ce-4e9eb0e8292e could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:33:51.532323 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-7a33171e-6dcc-40be-a4ff-387b1e54e3e8 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e" status: 404 len: 111 microversion: 2.1 time: 0.183064 May 17 17:33:51.532323 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 469/988] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:33:51 2022] GET /compute/v2.1/servers/ecb716a9-d5f9-485a-85ce-4e9eb0e8292e => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 17:33:52.807691 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0a9b6879-f706-4088-83ae-0689b9da422f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:52.808204 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0a9b6879-f706-4088-83ae-0689b9da422f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:52.815047 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0a9b6879-f706-4088-83ae-0689b9da422f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:52.815498 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0a9b6879-f706-4088-83ae-0689b9da422f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:52.816321 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0a9b6879-f706-4088-83ae-0689b9da422f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:52.816789 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0a9b6879-f706-4088-83ae-0689b9da422f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:52.830658 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-0a9b6879-f706-4088-83ae-0689b9da422f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] HTTP exception thrown: Instance ace49a2e-2ed3-43e0-a7c4-e275251ff690 could not be found. May 17 17:33:52.832198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0a9b6879-f706-4088-83ae-0689b9da422f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Request method failure captured: May 17 17:33:52.832198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: request: DELETE /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690 HTTP/1.1 May 17 17:33:52.832198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 17 17:33:52.832198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 17 17:33:52.832198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Connection: close May 17 17:33:52.832198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 17 17:33:52.832198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 17 17:33:52.832198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.88 May 17 17:33:52.832198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 17 17:33:52.832198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 17 17:33:52.832198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABig9tWg17ELpg_TTkWzbFxHdaAAQsss46MNpXjEEnfH7yXijN80XDWmxF0PUmXoUksbJKowpEVVnYtBVvoWuiL6GXCGYlSppsHPRNYd8MeFV0B2bmGGuVwLt685v1qI8gbaO7aXhyrZ0FembuKv9KvgsXW4ySi9m_Wz_eukMKqtMUcZBY May 17 17:33:52.832198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 17 17:33:52.832198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 17 17:33:52.832198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 17 17:33:52.832198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 17 17:33:52.832198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 17 17:33:52.832198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 17 17:33:52.832198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Id: ed4b8b6a551347b6a920e4cfb59b9480 May 17 17:33:52.832198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:33:52.832198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Role: reader,member May 17 17:33:52.832198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Roles: reader,member May 17 17:33:52.833935 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ed4b8b6a551347b6a920e4cfb59b9480", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:33:52.833935 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:33:52.833935 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: ed4b8b6a551347b6a920e4cfb59b9480 May 17 17:33:52.833935 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:33:52.833935 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeNegativeTest-1113418987-project May 17 17:33:52.833935 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 17 17:33:52.833935 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 17 17:33:52.833935 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Id: 7b22bf1b41774f64b7a380d86ef3f72e May 17 17:33:52.833935 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeNegativeTest-1113418987-project May 17 17:33:52.833935 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: method: > May 17 17:33:52.833935 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: exception: Instance ace49a2e-2ed3-43e0-a7c4-e275251ff690 could not be found. May 17 17:33:52.833935 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: action_args: {'id': 'ace49a2e-2ed3-43e0-a7c4-e275251ff690'} May 17 17:33:52.834804 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:33:52.834804 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:52.834804 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:33:52.834804 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:33:52.834804 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:33:52.834804 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:33:52.834804 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:33:52.834804 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:33:52.834804 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:33:52.834804 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:33:52.834804 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ace49a2e-2ed3-43e0-a7c4-e275251ff690 could not be found. May 17 17:33:52.834804 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:52.834804 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:33:52.834804 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:52.834804 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:52.834804 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:33:52.834804 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:33:52.834804 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:33:52.834804 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:33:52.834804 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:33:52.836414 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:33:52.836414 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 17:33:52.836414 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 17:33:52.836414 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 17:33:52.836414 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 17:33:52.836414 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:33:52.836414 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:33:52.836414 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:33:52.836414 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:33:52.836414 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ace49a2e-2ed3-43e0-a7c4-e275251ff690 could not be found. May 17 17:33:52.836414 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:52.836414 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:33:52.836414 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:52.836414 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:52.836414 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:33:52.836414 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:33:52.836414 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:33:52.836414 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:33:52.836414 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ace49a2e-2ed3-43e0-a7c4-e275251ff690 could not be found. May 17 17:33:52.836414 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 17 17:33:52.838164 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0a9b6879-f706-4088-83ae-0689b9da422f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Returning 404 to user: Instance ace49a2e-2ed3-43e0-a7c4-e275251ff690 could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:33:52.838164 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0a9b6879-f706-4088-83ae-0689b9da422f tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "DELETE /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690" status: 404 len: 111 microversion: 2.1 time: 0.029729 May 17 17:33:52.838164 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 520/989] 10.222.0.88 () {58 vars in 1238 bytes} [Tue May 17 17:33:52 2022] DELETE /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:33:52.842014 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1716a7c6-3113-4174-9ef1-c094cc712280 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:33:52.842635 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1716a7c6-3113-4174-9ef1-c094cc712280 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] [instance: ace49a2e-2ed3-43e0-a7c4-e275251ff690] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:33:52.849509 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1716a7c6-3113-4174-9ef1-c094cc712280 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:52.849966 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1716a7c6-3113-4174-9ef1-c094cc712280 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:52.850729 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1716a7c6-3113-4174-9ef1-c094cc712280 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:33:52.851175 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1716a7c6-3113-4174-9ef1-c094cc712280 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:33:52.863876 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-1716a7c6-3113-4174-9ef1-c094cc712280 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] HTTP exception thrown: Instance ace49a2e-2ed3-43e0-a7c4-e275251ff690 could not be found. May 17 17:33:52.865363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1716a7c6-3113-4174-9ef1-c094cc712280 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Request method failure captured: May 17 17:33:52.865363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690 HTTP/1.1 May 17 17:33:52.865363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:33:52.865363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:33:52.865363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:33:52.865363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:33:52.865363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:33:52.865363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:33:52.865363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:33:52.865363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:33:52.865363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9tWg17ELpg_TTkWzbFxHdaAAQsss46MNpXjEEnfH7yXijN80XDWmxF0PUmXoUksbJKowpEVVnYtBVvoWuiL6GXCGYlSppsHPRNYd8MeFV0B2bmGGuVwLt685v1qI8gbaO7aXhyrZ0FembuKv9KvgsXW4ySi9m_Wz_eukMKqtMUcZBY May 17 17:33:52.865363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:33:52.865363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:33:52.865363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:33:52.865363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:33:52.865363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:33:52.865363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:33:52.865363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: ed4b8b6a551347b6a920e4cfb59b9480 May 17 17:33:52.865363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:33:52.865363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:33:52.865363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:33:52.867038 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ed4b8b6a551347b6a920e4cfb59b9480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ed4b8b6a551347b6a920e4cfb59b9480", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:33:52.867038 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:33:52.867038 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: ed4b8b6a551347b6a920e4cfb59b9480 May 17 17:33:52.867038 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1113418987 May 17 17:33:52.867038 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-AttachVolumeNegativeTest-1113418987-project May 17 17:33:52.867038 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:33:52.867038 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:33:52.867038 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 7b22bf1b41774f64b7a380d86ef3f72e May 17 17:33:52.867038 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-AttachVolumeNegativeTest-1113418987-project May 17 17:33:52.867038 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:33:52.867038 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Instance ace49a2e-2ed3-43e0-a7c4-e275251ff690 could not be found. May 17 17:33:52.867038 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': 'ace49a2e-2ed3-43e0-a7c4-e275251ff690'} May 17 17:33:52.868172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:33:52.868172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:52.868172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:33:52.868172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:33:52.868172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:33:52.868172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:33:52.868172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:33:52.868172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:33:52.868172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:33:52.868172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:33:52.868172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ace49a2e-2ed3-43e0-a7c4-e275251ff690 could not be found. May 17 17:33:52.868172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:52.868172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:33:52.868172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:52.868172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:52.868172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:33:52.868172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:33:52.868172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:33:52.868172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:33:52.868172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:33:52.869694 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:33:52.869694 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:33:52.869694 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:33:52.869694 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:33:52.869694 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:33:52.869694 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:33:52.869694 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:33:52.869694 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ace49a2e-2ed3-43e0-a7c4-e275251ff690 could not be found. May 17 17:33:52.869694 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:52.869694 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:33:52.869694 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:52.869694 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:33:52.869694 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:33:52.869694 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:33:52.869694 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:33:52.869694 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:33:52.869694 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ace49a2e-2ed3-43e0-a7c4-e275251ff690 could not be found. May 17 17:33:52.869694 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:33:52.871102 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1716a7c6-3113-4174-9ef1-c094cc712280 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] Returning 404 to user: Instance ace49a2e-2ed3-43e0-a7c4-e275251ff690 could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:33:52.871102 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1716a7c6-3113-4174-9ef1-c094cc712280 tempest-AttachVolumeNegativeTest-1113418987 tempest-AttachVolumeNegativeTest-1113418987-project] 10.222.0.88 "GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690" status: 404 len: 111 microversion: 2.1 time: 0.028583 May 17 17:33:52.871102 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 470/990] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:33:52 2022] GET /compute/v2.1/servers/ace49a2e-2ed3-43e0-a7c4-e275251ff690 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:35:24.618342 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 17:35:24.618923 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Tue May 17 17:35:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 17:35:36.873280 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 17:35:36.873967 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Tue May 17 17:35:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 17:35:54.315383 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-bcea71c0-e3c2-4e69-8b28-8918dbd5d7f3 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1250812331", "imageRef": "800c492c-ff69-4735-b2c9-a2dcaa20aa8d", "flavorRef": "452", "networks": [{"uuid": "df08e4cf-bb4a-4302-b29c-b12730e670cf"}]}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:35:54.365541 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.network.neutron [None req-bcea71c0-e3c2-4e69-8b28-8918dbd5d7f3 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] validate_networks() for [('df08e4cf-bb4a-4302-b29c-b12730e670cf', None, None, None, None, None)] {{(pid=117612) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:35:54.742590 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-bcea71c0-e3c2-4e69-8b28-8918dbd5d7f3 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Flavor limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:35:54.743010 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-bcea71c0-e3c2-4e69-8b28-8918dbd5d7f3 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Image limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:35:54.743474 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-bcea71c0-e3c2-4e69-8b28-8918dbd5d7f3 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Flavor pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:35:54.743942 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-bcea71c0-e3c2-4e69-8b28-8918dbd5d7f3 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Image pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:35:54.744347 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-bcea71c0-e3c2-4e69-8b28-8918dbd5d7f3 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:35:54.752768 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bcea71c0-e3c2-4e69-8b28-8918dbd5d7f3 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:35:54.753487 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bcea71c0-e3c2-4e69-8b28-8918dbd5d7f3 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:35:54.754284 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bcea71c0-e3c2-4e69-8b28-8918dbd5d7f3 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:35:54.754718 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bcea71c0-e3c2-4e69-8b28-8918dbd5d7f3 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:35:54.770306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-bcea71c0-e3c2-4e69-8b28-8918dbd5d7f3 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Getting quotas for project b8bbed2f6e14438d8d7ccf6d3b8144b4. Resources: {'cores', 'ram', 'instances'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:35:54.774085 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-bcea71c0-e3c2-4e69-8b28-8918dbd5d7f3 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Getting quotas for user 5a1536ef9fb14fd78a89b7e350f80946 and project b8bbed2f6e14438d8d7ccf6d3b8144b4. Resources: {'cores', 'ram', 'instances'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:35:54.785453 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-bcea71c0-e3c2-4e69-8b28-8918dbd5d7f3 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Going to run 1 instances... {{(pid=117612) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:35:54.787972 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-bcea71c0-e3c2-4e69-8b28-8918dbd5d7f3 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: bcd23fc9-2f51-4fde-81d2-802277cb89f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='800c492c-ff69-4735-b2c9-a2dcaa20aa8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:35:54.965072 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-bcea71c0-e3c2-4e69-8b28-8918dbd5d7f3 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653984 May 17 17:35:54.971367 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 521/991] 10.222.0.88 () {60 vars in 1146 bytes} [Tue May 17 17:35:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:35:54.974628 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b9c8e2af-d264-48ff-ac53-533d691861c3] AMQP server on 10.222.0.88:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 17 17:35:54.978497 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b78a1ec8-4631-409e-9455-144b317e22b7 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:35:54.979103 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b78a1ec8-4631-409e-9455-144b317e22b7 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: bcd23fc9-2f51-4fde-81d2-802277cb89f1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:35:55.034996 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b78a1ec8-4631-409e-9455-144b317e22b7 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1536ef9fb14fd78a89b7e350f80946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bbed2f6e14438d8d7ccf6d3b8144b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:35:55.041809 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b78a1ec8-4631-409e-9455-144b317e22b7 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1" status: 200 len: 1219 microversion: 2.1 time: 0.069220 May 17 17:35:55.042348 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 471/992] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:35:54 2022] GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:35:56.058543 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ff6e17df-77c1-4b37-aa81-4aeede5c1f06 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:35:56.059137 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ff6e17df-77c1-4b37-aa81-4aeede5c1f06 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: bcd23fc9-2f51-4fde-81d2-802277cb89f1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:35:56.110941 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ff6e17df-77c1-4b37-aa81-4aeede5c1f06 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1536ef9fb14fd78a89b7e350f80946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bbed2f6e14438d8d7ccf6d3b8144b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:35:56.117530 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ff6e17df-77c1-4b37-aa81-4aeede5c1f06 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1" status: 200 len: 1219 microversion: 2.1 time: 0.062801 May 17 17:35:56.122476 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 522/993] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:35:56 2022] GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1 => generated 1219 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:35:57.135151 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-54a81127-129d-43b2-aeb1-134925552a84 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:35:57.135816 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-54a81127-129d-43b2-aeb1-134925552a84 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: bcd23fc9-2f51-4fde-81d2-802277cb89f1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:35:57.148253 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO oslo.messaging._drivers.impl_rabbit [-] [b9c8e2af-d264-48ff-ac53-533d691861c3] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 39880. May 17 17:35:57.150180 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-54a81127-129d-43b2-aeb1-134925552a84 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:35:57.150327 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-54a81127-129d-43b2-aeb1-134925552a84 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:35:57.151020 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-54a81127-129d-43b2-aeb1-134925552a84 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:35:57.151505 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-54a81127-129d-43b2-aeb1-134925552a84 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:35:57.212023 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-54a81127-129d-43b2-aeb1-134925552a84 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1536ef9fb14fd78a89b7e350f80946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bbed2f6e14438d8d7ccf6d3b8144b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:35:57.219204 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-54a81127-129d-43b2-aeb1-134925552a84 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1" status: 200 len: 1271 microversion: 2.1 time: 0.088119 May 17 17:35:57.219784 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 472/994] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:35:57 2022] GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:35:58.236674 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0250fdad-4678-49d6-94f7-463e99542d4b tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:35:58.237286 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0250fdad-4678-49d6-94f7-463e99542d4b tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: bcd23fc9-2f51-4fde-81d2-802277cb89f1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:35:58.243662 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0250fdad-4678-49d6-94f7-463e99542d4b tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:35:58.244130 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0250fdad-4678-49d6-94f7-463e99542d4b tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:35:58.244893 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0250fdad-4678-49d6-94f7-463e99542d4b tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:35:58.245337 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0250fdad-4678-49d6-94f7-463e99542d4b tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:35:58.462026 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0250fdad-4678-49d6-94f7-463e99542d4b tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1536ef9fb14fd78a89b7e350f80946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bbed2f6e14438d8d7ccf6d3b8144b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:35:58.470198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0250fdad-4678-49d6-94f7-463e99542d4b tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1" status: 200 len: 1319 microversion: 2.1 time: 0.237360 May 17 17:35:58.470807 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 523/995] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:35:58 2022] GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1 => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:35:59.313769 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-e3a83762-3355-4f1e-bbf9-f4e20a6b12b3 req-08356f1f-9252-43ea-9b3c-647172ec6ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcd23fc9-2f51-4fde-81d2-802277cb89f1", "tag": "54847386-1e31-4b0d-8377-d462126e0a75"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:35:59.321797 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-e3a83762-3355-4f1e-bbf9-f4e20a6b12b3 req-08356f1f-9252-43ea-9b3c-647172ec6ca9 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:35:59.322264 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-e3a83762-3355-4f1e-bbf9-f4e20a6b12b3 req-08356f1f-9252-43ea-9b3c-647172ec6ca9 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:35:59.333409 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-e3a83762-3355-4f1e-bbf9-f4e20a6b12b3 req-08356f1f-9252-43ea-9b3c-647172ec6ca9 service nova] Creating event network-changed:54847386-1e31-4b0d-8377-d462126e0a75 for instance bcd23fc9-2f51-4fde-81d2-802277cb89f1 on hv-cinder-84214 May 17 17:35:59.338733 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-e3a83762-3355-4f1e-bbf9-f4e20a6b12b3 req-08356f1f-9252-43ea-9b3c-647172ec6ca9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028922 May 17 17:35:59.339132 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 473/996] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:35:59.487305 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-346d393a-ee45-4294-9484-60ee2a275cdb tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:35:59.488548 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-346d393a-ee45-4294-9484-60ee2a275cdb tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: bcd23fc9-2f51-4fde-81d2-802277cb89f1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:35:59.494923 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-346d393a-ee45-4294-9484-60ee2a275cdb tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:35:59.495376 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-346d393a-ee45-4294-9484-60ee2a275cdb tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:35:59.496187 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-346d393a-ee45-4294-9484-60ee2a275cdb tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:35:59.497153 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-346d393a-ee45-4294-9484-60ee2a275cdb tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:35:59.684792 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-346d393a-ee45-4294-9484-60ee2a275cdb tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1536ef9fb14fd78a89b7e350f80946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bbed2f6e14438d8d7ccf6d3b8144b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:35:59.692897 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-346d393a-ee45-4294-9484-60ee2a275cdb tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1" status: 200 len: 1319 microversion: 2.1 time: 0.209336 May 17 17:35:59.693464 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 524/997] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:35:59 2022] GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:36:00.710602 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-91589276-6180-4d05-8efa-a1304d413f1b tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:36:00.711297 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-91589276-6180-4d05-8efa-a1304d413f1b tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: bcd23fc9-2f51-4fde-81d2-802277cb89f1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:36:00.717579 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-91589276-6180-4d05-8efa-a1304d413f1b tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:36:00.718026 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-91589276-6180-4d05-8efa-a1304d413f1b tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:36:00.718788 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-91589276-6180-4d05-8efa-a1304d413f1b tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:36:00.719221 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-91589276-6180-4d05-8efa-a1304d413f1b tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:36:00.847281 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-91589276-6180-4d05-8efa-a1304d413f1b tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1536ef9fb14fd78a89b7e350f80946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bbed2f6e14438d8d7ccf6d3b8144b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:36:00.854572 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-91589276-6180-4d05-8efa-a1304d413f1b tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1" status: 200 len: 1319 microversion: 2.1 time: 0.148685 May 17 17:36:00.855130 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 474/998] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:36:00 2022] GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:36:01.871711 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0d69ceae-7e1d-46a5-93f7-7c96b77e31a0 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:36:01.872319 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0d69ceae-7e1d-46a5-93f7-7c96b77e31a0 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: bcd23fc9-2f51-4fde-81d2-802277cb89f1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:36:01.878609 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0d69ceae-7e1d-46a5-93f7-7c96b77e31a0 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:36:01.879062 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0d69ceae-7e1d-46a5-93f7-7c96b77e31a0 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:36:01.879892 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0d69ceae-7e1d-46a5-93f7-7c96b77e31a0 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:36:01.880331 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0d69ceae-7e1d-46a5-93f7-7c96b77e31a0 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:36:02.270852 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0d69ceae-7e1d-46a5-93f7-7c96b77e31a0 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1536ef9fb14fd78a89b7e350f80946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bbed2f6e14438d8d7ccf6d3b8144b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:36:02.278027 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0d69ceae-7e1d-46a5-93f7-7c96b77e31a0 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1" status: 200 len: 1319 microversion: 2.1 time: 0.410302 May 17 17:36:02.278588 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 525/999] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:36:01 2022] GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1 => generated 1319 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:36:03.295401 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-cbae5bf9-6a9e-410d-99e1-831a5b140301 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:36:03.296098 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-cbae5bf9-6a9e-410d-99e1-831a5b140301 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: bcd23fc9-2f51-4fde-81d2-802277cb89f1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:36:03.302557 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cbae5bf9-6a9e-410d-99e1-831a5b140301 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:36:03.302999 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cbae5bf9-6a9e-410d-99e1-831a5b140301 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:36:03.303785 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cbae5bf9-6a9e-410d-99e1-831a5b140301 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:36:03.304232 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cbae5bf9-6a9e-410d-99e1-831a5b140301 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:36:03.427574 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-cbae5bf9-6a9e-410d-99e1-831a5b140301 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1536ef9fb14fd78a89b7e350f80946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bbed2f6e14438d8d7ccf6d3b8144b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:36:03.434737 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-cbae5bf9-6a9e-410d-99e1-831a5b140301 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1" status: 200 len: 1319 microversion: 2.1 time: 0.143271 May 17 17:36:03.435283 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 475/1000] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:36:03 2022] GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1 => generated 1319 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:36:03.820467 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-43556b23-ae4b-4613-b875-48c061412589 req-aafcc4ca-5559-42c1-bdfd-5b1e2c2798a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd23fc9-2f51-4fde-81d2-802277cb89f1", "name": "network-vif-plugged", "status": "completed", "tag": "54847386-1e31-4b0d-8377-d462126e0a75"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:36:03.830390 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-43556b23-ae4b-4613-b875-48c061412589 req-aafcc4ca-5559-42c1-bdfd-5b1e2c2798a5 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:36:03.830834 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-43556b23-ae4b-4613-b875-48c061412589 req-aafcc4ca-5559-42c1-bdfd-5b1e2c2798a5 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:36:03.841465 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-43556b23-ae4b-4613-b875-48c061412589 req-aafcc4ca-5559-42c1-bdfd-5b1e2c2798a5 service nova] Creating event network-vif-plugged:54847386-1e31-4b0d-8377-d462126e0a75 for instance bcd23fc9-2f51-4fde-81d2-802277cb89f1 on hv-cinder-84214 May 17 17:36:03.846644 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-43556b23-ae4b-4613-b875-48c061412589 req-aafcc4ca-5559-42c1-bdfd-5b1e2c2798a5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178674 May 17 17:36:03.847216 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 526/1001] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:36:04.451476 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-04de33a7-99a0-48d9-b0b2-5e99d2e6adec tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:36:04.452110 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-04de33a7-99a0-48d9-b0b2-5e99d2e6adec tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: bcd23fc9-2f51-4fde-81d2-802277cb89f1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:36:04.458403 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-04de33a7-99a0-48d9-b0b2-5e99d2e6adec tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:36:04.460199 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-04de33a7-99a0-48d9-b0b2-5e99d2e6adec tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:36:04.460199 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-04de33a7-99a0-48d9-b0b2-5e99d2e6adec tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:36:04.460199 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-04de33a7-99a0-48d9-b0b2-5e99d2e6adec tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:36:04.586047 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-04de33a7-99a0-48d9-b0b2-5e99d2e6adec tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1536ef9fb14fd78a89b7e350f80946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bbed2f6e14438d8d7ccf6d3b8144b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:36:04.593698 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-04de33a7-99a0-48d9-b0b2-5e99d2e6adec tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1" status: 200 len: 1319 microversion: 2.1 time: 0.146087 May 17 17:36:04.594241 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 476/1002] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:36:04 2022] GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:36:05.611839 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7b47adfb-b043-4302-9bdd-c1edbffbce2e tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:36:05.612509 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-7b47adfb-b043-4302-9bdd-c1edbffbce2e tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: bcd23fc9-2f51-4fde-81d2-802277cb89f1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:36:05.618743 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7b47adfb-b043-4302-9bdd-c1edbffbce2e tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:36:05.619197 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7b47adfb-b043-4302-9bdd-c1edbffbce2e tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:36:05.620949 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7b47adfb-b043-4302-9bdd-c1edbffbce2e tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:36:05.620949 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7b47adfb-b043-4302-9bdd-c1edbffbce2e tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:36:05.751809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7b47adfb-b043-4302-9bdd-c1edbffbce2e tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1536ef9fb14fd78a89b7e350f80946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bbed2f6e14438d8d7ccf6d3b8144b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:36:05.759150 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7b47adfb-b043-4302-9bdd-c1edbffbce2e tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1" status: 200 len: 1319 microversion: 2.1 time: 0.152111 May 17 17:36:05.759734 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 527/1003] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:36:05 2022] GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:36:06.775895 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7a15412e-dde0-44ba-86ea-368d93780512 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:36:06.776553 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-7a15412e-dde0-44ba-86ea-368d93780512 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: bcd23fc9-2f51-4fde-81d2-802277cb89f1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:36:06.782785 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7a15412e-dde0-44ba-86ea-368d93780512 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:36:06.783228 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7a15412e-dde0-44ba-86ea-368d93780512 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:36:06.784017 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7a15412e-dde0-44ba-86ea-368d93780512 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:36:06.784449 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7a15412e-dde0-44ba-86ea-368d93780512 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:36:06.908355 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7a15412e-dde0-44ba-86ea-368d93780512 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1536ef9fb14fd78a89b7e350f80946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bbed2f6e14438d8d7ccf6d3b8144b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:36:06.915717 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-7a15412e-dde0-44ba-86ea-368d93780512 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1" status: 200 len: 1508 microversion: 2.1 time: 0.143681 May 17 17:36:06.916448 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 477/1004] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:36:06 2022] GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1 => generated 1508 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:36:23.335225 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0b4c73f7-87d5-468c-9fe5-c0d43a671d80 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5e845d1-ecae-4f16-ab14-6b2ab41ce119", "device": "/dev/sdb"}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:36:23.336815 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0b4c73f7-87d5-468c-9fe5-c0d43a671d80 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: bcd23fc9-2f51-4fde-81d2-802277cb89f1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:36:23.343177 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0b4c73f7-87d5-468c-9fe5-c0d43a671d80 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:36:23.343680 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0b4c73f7-87d5-468c-9fe5-c0d43a671d80 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:36:23.344439 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0b4c73f7-87d5-468c-9fe5-c0d43a671d80 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:36:23.344865 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0b4c73f7-87d5-468c-9fe5-c0d43a671d80 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:36:24.204585 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0b4c73f7-87d5-468c-9fe5-c0d43a671d80 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "POST /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.873205 May 17 17:36:24.205200 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 528/1005] 10.222.0.88 () {60 vars in 1322 bytes} [Tue May 17 17:36:23 2022] POST /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1/os-volume_attachments => generated 194 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:36:48.834141 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1551a77b-77fe-4ae8-98d3-33c2d1345f28 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:36:48.834637 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1551a77b-77fe-4ae8-98d3-33c2d1345f28 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: bcd23fc9-2f51-4fde-81d2-802277cb89f1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:36:48.840529 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1551a77b-77fe-4ae8-98d3-33c2d1345f28 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:36:48.840974 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1551a77b-77fe-4ae8-98d3-33c2d1345f28 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:36:48.841735 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1551a77b-77fe-4ae8-98d3-33c2d1345f28 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:36:48.842169 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1551a77b-77fe-4ae8-98d3-33c2d1345f28 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:36:48.920029 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.objects.instance [None req-1551a77b-77fe-4ae8-98d3-33c2d1345f28 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lazy-loading 'services' on Instance uuid bcd23fc9-2f51-4fde-81d2-802277cb89f1 {{(pid=117611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:36:49.136565 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1551a77b-77fe-4ae8-98d3-33c2d1345f28 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "DELETE /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1/os-volume_attachments/b5e845d1-ecae-4f16-ab14-6b2ab41ce119" status: 202 len: 0 microversion: 2.1 time: 0.305937 May 17 17:36:49.137071 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 478/1006] 10.222.0.88 () {58 vars in 1415 bytes} [Tue May 17 17:36:48 2022] DELETE /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1/os-volume_attachments/b5e845d1-ecae-4f16-ab14-6b2ab41ce119 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:36:50.246302 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-40daec9f-c750-440a-b800-fb81e423110a tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:36:50.246891 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-40daec9f-c750-440a-b800-fb81e423110a tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: bcd23fc9-2f51-4fde-81d2-802277cb89f1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:36:50.253466 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-40daec9f-c750-440a-b800-fb81e423110a tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:36:50.253914 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-40daec9f-c750-440a-b800-fb81e423110a tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:36:50.254683 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-40daec9f-c750-440a-b800-fb81e423110a tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:36:50.255148 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-40daec9f-c750-440a-b800-fb81e423110a tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:36:50.279824 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-40daec9f-c750-440a-b800-fb81e423110a tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: bcd23fc9-2f51-4fde-81d2-802277cb89f1] Going to try to terminate instance {{(pid=117612) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:36:50.583212 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-40daec9f-c750-440a-b800-fb81e423110a tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "DELETE /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1" status: 204 len: 0 microversion: 2.1 time: 0.341330 May 17 17:36:50.583832 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 529/1007] 10.222.0.88 () {58 vars in 1238 bytes} [Tue May 17 17:36:50 2022] DELETE /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:36:50.592802 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-fb42281a-4c6b-48ee-bea0-19e1f999e296 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:36:50.593492 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-fb42281a-4c6b-48ee-bea0-19e1f999e296 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: bcd23fc9-2f51-4fde-81d2-802277cb89f1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:36:50.600089 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fb42281a-4c6b-48ee-bea0-19e1f999e296 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:36:50.600531 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fb42281a-4c6b-48ee-bea0-19e1f999e296 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:36:50.601287 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fb42281a-4c6b-48ee-bea0-19e1f999e296 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:36:50.601722 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fb42281a-4c6b-48ee-bea0-19e1f999e296 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:36:50.731001 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-fb42281a-4c6b-48ee-bea0-19e1f999e296 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1536ef9fb14fd78a89b7e350f80946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bbed2f6e14438d8d7ccf6d3b8144b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:36:50.738993 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-fb42281a-4c6b-48ee-bea0-19e1f999e296 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1" status: 200 len: 1514 microversion: 2.1 time: 0.150654 May 17 17:36:50.739566 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 479/1008] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:36:50 2022] GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:36:51.758485 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-945fc363-dc55-41b2-a704-868f91ab67d9 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:36:51.759179 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-945fc363-dc55-41b2-a704-868f91ab67d9 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: bcd23fc9-2f51-4fde-81d2-802277cb89f1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:36:51.765434 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-945fc363-dc55-41b2-a704-868f91ab67d9 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:36:51.765884 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-945fc363-dc55-41b2-a704-868f91ab67d9 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:36:51.767259 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-945fc363-dc55-41b2-a704-868f91ab67d9 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:36:51.767742 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-945fc363-dc55-41b2-a704-868f91ab67d9 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:36:51.891760 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-945fc363-dc55-41b2-a704-868f91ab67d9 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1536ef9fb14fd78a89b7e350f80946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bbed2f6e14438d8d7ccf6d3b8144b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:36:51.898919 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-945fc363-dc55-41b2-a704-868f91ab67d9 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1" status: 200 len: 1514 microversion: 2.1 time: 0.146504 May 17 17:36:51.899477 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 530/1009] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:36:51 2022] GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:36:52.888406 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-4f7f34d8-1538-46fb-af0a-0cd1aad99023 req-049e2d21-1e6a-4c76-b481-af8ed0955880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd23fc9-2f51-4fde-81d2-802277cb89f1", "name": "network-vif-deleted", "tag": "54847386-1e31-4b0d-8377-d462126e0a75"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:36:52.897657 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-4f7f34d8-1538-46fb-af0a-0cd1aad99023 req-049e2d21-1e6a-4c76-b481-af8ed0955880 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:36:52.898113 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-4f7f34d8-1538-46fb-af0a-0cd1aad99023 req-049e2d21-1e6a-4c76-b481-af8ed0955880 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:36:52.908864 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-4f7f34d8-1538-46fb-af0a-0cd1aad99023 req-049e2d21-1e6a-4c76-b481-af8ed0955880 service nova] Creating event network-vif-deleted:54847386-1e31-4b0d-8377-d462126e0a75 for instance bcd23fc9-2f51-4fde-81d2-802277cb89f1 on hv-cinder-84214 May 17 17:36:52.913978 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-4f7f34d8-1538-46fb-af0a-0cd1aad99023 req-049e2d21-1e6a-4c76-b481-af8ed0955880 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029249 May 17 17:36:52.914541 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 480/1010] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:36:52.915322 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6dd70ebe-c497-4358-92be-f9602a3cb9de tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:36:52.915960 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6dd70ebe-c497-4358-92be-f9602a3cb9de tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: bcd23fc9-2f51-4fde-81d2-802277cb89f1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:36:52.922247 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6dd70ebe-c497-4358-92be-f9602a3cb9de tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:36:52.928666 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6dd70ebe-c497-4358-92be-f9602a3cb9de tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:36:52.928666 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6dd70ebe-c497-4358-92be-f9602a3cb9de tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:36:52.928666 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6dd70ebe-c497-4358-92be-f9602a3cb9de tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:36:52.985867 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6dd70ebe-c497-4358-92be-f9602a3cb9de tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1536ef9fb14fd78a89b7e350f80946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bbed2f6e14438d8d7ccf6d3b8144b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:36:52.993889 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6dd70ebe-c497-4358-92be-f9602a3cb9de tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1" status: 200 len: 1472 microversion: 2.1 time: 0.082572 May 17 17:36:52.994465 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 531/1011] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:36:52 2022] GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1 => generated 1472 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:36:54.011258 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8fbf5eba-0dd3-4408-bdca-460ec629fb10 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:36:54.012014 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8fbf5eba-0dd3-4408-bdca-460ec629fb10 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: bcd23fc9-2f51-4fde-81d2-802277cb89f1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:36:54.019279 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8fbf5eba-0dd3-4408-bdca-460ec629fb10 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:36:54.019769 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8fbf5eba-0dd3-4408-bdca-460ec629fb10 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:36:54.020555 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8fbf5eba-0dd3-4408-bdca-460ec629fb10 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:36:54.020996 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8fbf5eba-0dd3-4408-bdca-460ec629fb10 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:36:54.034278 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-8fbf5eba-0dd3-4408-bdca-460ec629fb10 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] HTTP exception thrown: Instance bcd23fc9-2f51-4fde-81d2-802277cb89f1 could not be found. May 17 17:36:54.035954 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8fbf5eba-0dd3-4408-bdca-460ec629fb10 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Request method failure captured: May 17 17:36:54.035954 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1 HTTP/1.1 May 17 17:36:54.035954 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:36:54.035954 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:36:54.035954 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:36:54.035954 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:36:54.035954 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:36:54.035954 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:36:54.035954 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:36:54.035954 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:36:54.035954 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9z4EYaE1jWFy8R9_zOiDepbHhm0eX8vX9WH37DTrMOq0NwO9g5VxAZUrMIqhLEruJpwKVW0lmxbYdceUtfOzkBwFNOt2JsnX4n42eAQ1q1YxE-fEw01WCYVNmEIH_OBNGBycbDTyNwZS2sRQxmeTQ83Zn9BbzQGxr6UlRECknDeijg May 17 17:36:54.035954 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:36:54.035954 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:36:54.035954 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:36:54.035954 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:36:54.035954 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:36:54.035954 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:36:54.035954 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: b8bbed2f6e14438d8d7ccf6d3b8144b4 May 17 17:36:54.035954 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1144118160 May 17 17:36:54.035954 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:36:54.035954 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:36:54.037999 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b8bbed2f6e14438d8d7ccf6d3b8144b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b8bbed2f6e14438d8d7ccf6d3b8144b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b8bbed2f6e14438d8d7ccf6d3b8144b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b8bbed2f6e14438d8d7ccf6d3b8144b4", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:36:54.037999 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-VolumesSnapshotTestJSON-1144118160 May 17 17:36:54.037999 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: b8bbed2f6e14438d8d7ccf6d3b8144b4 May 17 17:36:54.037999 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1144118160 May 17 17:36:54.037999 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-VolumesSnapshotTestJSON-1144118160-project May 17 17:36:54.037999 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:36:54.037999 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:36:54.037999 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 5a1536ef9fb14fd78a89b7e350f80946 May 17 17:36:54.037999 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-VolumesSnapshotTestJSON-1144118160-project May 17 17:36:54.037999 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:36:54.037999 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Instance bcd23fc9-2f51-4fde-81d2-802277cb89f1 could not be found. May 17 17:36:54.037999 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': 'bcd23fc9-2f51-4fde-81d2-802277cb89f1'} May 17 17:36:54.039103 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:36:54.039103 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:36:54.039103 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:36:54.039103 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:36:54.039103 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:36:54.039103 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:36:54.039103 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:36:54.039103 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:36:54.039103 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:36:54.039103 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:36:54.039103 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcd23fc9-2f51-4fde-81d2-802277cb89f1 could not be found. May 17 17:36:54.039103 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:36:54.039103 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:36:54.039103 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:36:54.039103 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:36:54.039103 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:36:54.039103 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:36:54.039103 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:36:54.039103 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:36:54.039103 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:36:54.041050 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:36:54.041050 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:36:54.041050 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:36:54.041050 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:36:54.041050 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:36:54.041050 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:36:54.041050 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:36:54.041050 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcd23fc9-2f51-4fde-81d2-802277cb89f1 could not be found. May 17 17:36:54.041050 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:36:54.041050 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:36:54.041050 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:36:54.041050 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:36:54.041050 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:36:54.041050 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:36:54.041050 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:36:54.041050 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:36:54.041050 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcd23fc9-2f51-4fde-81d2-802277cb89f1 could not be found. May 17 17:36:54.041050 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:36:54.042603 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8fbf5eba-0dd3-4408-bdca-460ec629fb10 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Returning 404 to user: Instance bcd23fc9-2f51-4fde-81d2-802277cb89f1 could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:36:54.042603 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8fbf5eba-0dd3-4408-bdca-460ec629fb10 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1" status: 404 len: 111 microversion: 2.1 time: 0.030256 May 17 17:36:54.042603 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 481/1012] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:36:54 2022] GET /compute/v2.1/servers/bcd23fc9-2f51-4fde-81d2-802277cb89f1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:37:02.539298 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 17:37:02.540241 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Tue May 17 17:37:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 17:37:04.443772 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-69c9c5a9-e227-49b8-996a-d0d99683ce23 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1668798070", "imageRef": "800c492c-ff69-4735-b2c9-a2dcaa20aa8d", "flavorRef": "452", "networks": [{"uuid": "df08e4cf-bb4a-4302-b29c-b12730e670cf"}]}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:37:04.492534 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.network.neutron [None req-69c9c5a9-e227-49b8-996a-d0d99683ce23 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] validate_networks() for [('df08e4cf-bb4a-4302-b29c-b12730e670cf', None, None, None, None, None)] {{(pid=117612) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:37:04.828060 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-69c9c5a9-e227-49b8-996a-d0d99683ce23 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Flavor limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:37:04.828477 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-69c9c5a9-e227-49b8-996a-d0d99683ce23 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Image limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:37:04.828945 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-69c9c5a9-e227-49b8-996a-d0d99683ce23 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Flavor pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:37:04.829354 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-69c9c5a9-e227-49b8-996a-d0d99683ce23 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Image pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:37:04.829762 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-69c9c5a9-e227-49b8-996a-d0d99683ce23 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:37:04.838150 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-69c9c5a9-e227-49b8-996a-d0d99683ce23 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:04.838594 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-69c9c5a9-e227-49b8-996a-d0d99683ce23 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:04.839386 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-69c9c5a9-e227-49b8-996a-d0d99683ce23 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:04.839848 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-69c9c5a9-e227-49b8-996a-d0d99683ce23 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:04.856041 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-69c9c5a9-e227-49b8-996a-d0d99683ce23 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Getting quotas for project b8bbed2f6e14438d8d7ccf6d3b8144b4. Resources: {'cores', 'ram', 'instances'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:37:04.859834 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-69c9c5a9-e227-49b8-996a-d0d99683ce23 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Getting quotas for user 5a1536ef9fb14fd78a89b7e350f80946 and project b8bbed2f6e14438d8d7ccf6d3b8144b4. Resources: {'cores', 'ram', 'instances'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:37:04.870635 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-69c9c5a9-e227-49b8-996a-d0d99683ce23 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Going to run 1 instances... {{(pid=117612) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:37:04.872840 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-69c9c5a9-e227-49b8-996a-d0d99683ce23 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: 1cbb606a-06d4-4b05-83a5-cd2db40175c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='800c492c-ff69-4735-b2c9-a2dcaa20aa8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:37:05.011920 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-69c9c5a9-e227-49b8-996a-d0d99683ce23 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.572470 May 17 17:37:05.012555 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 532/1013] 10.222.0.88 () {60 vars in 1146 bytes} [Tue May 17 17:37:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:37:05.022485 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-0646d581-e295-4302-9393-64df0790c4ea tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:37:05.023110 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-0646d581-e295-4302-9393-64df0790c4ea tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: 1cbb606a-06d4-4b05-83a5-cd2db40175c7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:37:05.076033 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-0646d581-e295-4302-9393-64df0790c4ea tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1536ef9fb14fd78a89b7e350f80946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bbed2f6e14438d8d7ccf6d3b8144b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:37:05.082497 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-0646d581-e295-4302-9393-64df0790c4ea tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7" status: 200 len: 1219 microversion: 2.1 time: 0.064067 May 17 17:37:05.083052 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 482/1014] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:37:05 2022] GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7 => generated 1219 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:37:06.099809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f2e36c53-eb0d-4c07-9b63-426b33252990 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:37:06.100624 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f2e36c53-eb0d-4c07-9b63-426b33252990 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: 1cbb606a-06d4-4b05-83a5-cd2db40175c7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:37:06.106710 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f2e36c53-eb0d-4c07-9b63-426b33252990 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:06.107205 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f2e36c53-eb0d-4c07-9b63-426b33252990 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:06.107973 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f2e36c53-eb0d-4c07-9b63-426b33252990 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:06.108411 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f2e36c53-eb0d-4c07-9b63-426b33252990 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:06.167819 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f2e36c53-eb0d-4c07-9b63-426b33252990 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1536ef9fb14fd78a89b7e350f80946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bbed2f6e14438d8d7ccf6d3b8144b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:37:06.175024 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f2e36c53-eb0d-4c07-9b63-426b33252990 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7" status: 200 len: 1223 microversion: 2.1 time: 0.079590 May 17 17:37:06.175601 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 533/1015] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:37:06 2022] GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:37:07.193142 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-609c3c47-f76d-4dbd-8b46-c2c8dbd5d0f0 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:37:07.193822 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-609c3c47-f76d-4dbd-8b46-c2c8dbd5d0f0 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: 1cbb606a-06d4-4b05-83a5-cd2db40175c7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:37:07.200305 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-609c3c47-f76d-4dbd-8b46-c2c8dbd5d0f0 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:07.200759 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-609c3c47-f76d-4dbd-8b46-c2c8dbd5d0f0 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:07.201537 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-609c3c47-f76d-4dbd-8b46-c2c8dbd5d0f0 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:07.201975 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-609c3c47-f76d-4dbd-8b46-c2c8dbd5d0f0 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:07.263499 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-609c3c47-f76d-4dbd-8b46-c2c8dbd5d0f0 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1536ef9fb14fd78a89b7e350f80946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bbed2f6e14438d8d7ccf6d3b8144b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:37:07.271234 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-609c3c47-f76d-4dbd-8b46-c2c8dbd5d0f0 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7" status: 200 len: 1289 microversion: 2.1 time: 0.082407 May 17 17:37:07.271812 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 483/1016] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:37:07 2022] GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7 => generated 1289 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:37:08.288927 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-cee1508e-b803-4045-9f85-eee00b819205 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:37:08.289545 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-cee1508e-b803-4045-9f85-eee00b819205 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: 1cbb606a-06d4-4b05-83a5-cd2db40175c7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:37:08.296116 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cee1508e-b803-4045-9f85-eee00b819205 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:08.296569 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cee1508e-b803-4045-9f85-eee00b819205 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:08.297338 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cee1508e-b803-4045-9f85-eee00b819205 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:08.297779 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cee1508e-b803-4045-9f85-eee00b819205 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:08.502591 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-cee1508e-b803-4045-9f85-eee00b819205 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1536ef9fb14fd78a89b7e350f80946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bbed2f6e14438d8d7ccf6d3b8144b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:37:08.509782 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-cee1508e-b803-4045-9f85-eee00b819205 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7" status: 200 len: 1319 microversion: 2.1 time: 0.225394 May 17 17:37:08.510351 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 534/1017] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:37:08 2022] GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:37:08.732737 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-f8a62ec1-700d-4091-8036-ccde13f99d43 req-69fa051f-831b-4fef-98c3-bc12599b1f2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cbb606a-06d4-4b05-83a5-cd2db40175c7", "tag": "39914f7e-729f-4d6c-9223-1e0859b34121"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:37:08.741289 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-f8a62ec1-700d-4091-8036-ccde13f99d43 req-69fa051f-831b-4fef-98c3-bc12599b1f2a service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:08.741740 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-f8a62ec1-700d-4091-8036-ccde13f99d43 req-69fa051f-831b-4fef-98c3-bc12599b1f2a service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:08.754122 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-f8a62ec1-700d-4091-8036-ccde13f99d43 req-69fa051f-831b-4fef-98c3-bc12599b1f2a service nova] Creating event network-changed:39914f7e-729f-4d6c-9223-1e0859b34121 for instance 1cbb606a-06d4-4b05-83a5-cd2db40175c7 on hv-cinder-84214 May 17 17:37:08.759332 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-f8a62ec1-700d-4091-8036-ccde13f99d43 req-69fa051f-831b-4fef-98c3-bc12599b1f2a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030338 May 17 17:37:08.759972 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 484/1018] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:37:09.526585 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d53315f3-4359-4fcb-95a9-f8ceb0c0ad15 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:37:09.527214 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d53315f3-4359-4fcb-95a9-f8ceb0c0ad15 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: 1cbb606a-06d4-4b05-83a5-cd2db40175c7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:37:09.533612 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d53315f3-4359-4fcb-95a9-f8ceb0c0ad15 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:09.534100 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d53315f3-4359-4fcb-95a9-f8ceb0c0ad15 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:09.534901 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d53315f3-4359-4fcb-95a9-f8ceb0c0ad15 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:09.535333 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d53315f3-4359-4fcb-95a9-f8ceb0c0ad15 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:09.670655 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d53315f3-4359-4fcb-95a9-f8ceb0c0ad15 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1536ef9fb14fd78a89b7e350f80946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bbed2f6e14438d8d7ccf6d3b8144b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:37:09.678643 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d53315f3-4359-4fcb-95a9-f8ceb0c0ad15 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7" status: 200 len: 1319 microversion: 2.1 time: 0.155972 May 17 17:37:09.679240 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 535/1019] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:37:09 2022] GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:37:10.696442 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-eb79ed5c-132a-4c05-87ec-a54df0de44b6 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:37:10.697140 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-eb79ed5c-132a-4c05-87ec-a54df0de44b6 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: 1cbb606a-06d4-4b05-83a5-cd2db40175c7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:37:10.703165 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-eb79ed5c-132a-4c05-87ec-a54df0de44b6 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:10.703643 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-eb79ed5c-132a-4c05-87ec-a54df0de44b6 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:10.704408 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-eb79ed5c-132a-4c05-87ec-a54df0de44b6 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:10.704846 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-eb79ed5c-132a-4c05-87ec-a54df0de44b6 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:10.831145 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-eb79ed5c-132a-4c05-87ec-a54df0de44b6 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1536ef9fb14fd78a89b7e350f80946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bbed2f6e14438d8d7ccf6d3b8144b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:37:10.838895 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-eb79ed5c-132a-4c05-87ec-a54df0de44b6 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7" status: 200 len: 1319 microversion: 2.1 time: 0.147232 May 17 17:37:10.839445 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 485/1020] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:37:10 2022] GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:37:11.855537 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2aa288a8-d72c-4f6e-8911-0d2a5875d21e tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:37:11.856184 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2aa288a8-d72c-4f6e-8911-0d2a5875d21e tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: 1cbb606a-06d4-4b05-83a5-cd2db40175c7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:37:11.862520 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2aa288a8-d72c-4f6e-8911-0d2a5875d21e tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:11.862967 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2aa288a8-d72c-4f6e-8911-0d2a5875d21e tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:11.863759 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2aa288a8-d72c-4f6e-8911-0d2a5875d21e tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:11.864193 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2aa288a8-d72c-4f6e-8911-0d2a5875d21e tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:11.996471 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2aa288a8-d72c-4f6e-8911-0d2a5875d21e tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1536ef9fb14fd78a89b7e350f80946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bbed2f6e14438d8d7ccf6d3b8144b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:37:12.003668 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2aa288a8-d72c-4f6e-8911-0d2a5875d21e tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7" status: 200 len: 1319 microversion: 2.1 time: 0.151987 May 17 17:37:12.004306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 536/1021] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:37:11 2022] GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:37:13.020338 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3e9c698c-612f-48c3-9257-849cbf8cbff3 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:37:13.020951 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3e9c698c-612f-48c3-9257-849cbf8cbff3 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: 1cbb606a-06d4-4b05-83a5-cd2db40175c7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:37:13.027268 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3e9c698c-612f-48c3-9257-849cbf8cbff3 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:13.027760 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3e9c698c-612f-48c3-9257-849cbf8cbff3 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:13.028528 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3e9c698c-612f-48c3-9257-849cbf8cbff3 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:13.028965 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3e9c698c-612f-48c3-9257-849cbf8cbff3 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:13.151628 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3e9c698c-612f-48c3-9257-849cbf8cbff3 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1536ef9fb14fd78a89b7e350f80946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bbed2f6e14438d8d7ccf6d3b8144b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:37:13.158745 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3e9c698c-612f-48c3-9257-849cbf8cbff3 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7" status: 200 len: 1319 microversion: 2.1 time: 0.142270 May 17 17:37:13.159299 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 486/1022] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:37:13 2022] GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7 => generated 1319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:37:14.060950 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-cfc36a10-793e-4a74-aaa6-3501a6fa5863 req-4b27fd50-4c9f-4264-8269-ddac08f19083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cbb606a-06d4-4b05-83a5-cd2db40175c7", "name": "network-vif-plugged", "status": "completed", "tag": "39914f7e-729f-4d6c-9223-1e0859b34121"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:37:14.069815 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-cfc36a10-793e-4a74-aaa6-3501a6fa5863 req-4b27fd50-4c9f-4264-8269-ddac08f19083 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:14.074994 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-cfc36a10-793e-4a74-aaa6-3501a6fa5863 req-4b27fd50-4c9f-4264-8269-ddac08f19083 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:14.081060 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-cfc36a10-793e-4a74-aaa6-3501a6fa5863 req-4b27fd50-4c9f-4264-8269-ddac08f19083 service nova] Creating event network-vif-plugged:39914f7e-729f-4d6c-9223-1e0859b34121 for instance 1cbb606a-06d4-4b05-83a5-cd2db40175c7 on hv-cinder-84214 May 17 17:37:14.086685 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-cfc36a10-793e-4a74-aaa6-3501a6fa5863 req-4b27fd50-4c9f-4264-8269-ddac08f19083 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029642 May 17 17:37:14.087404 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 537/1023] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:37:14.176882 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3ebff306-e488-4c1a-b1d5-6f00d89b1231 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:37:14.177506 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3ebff306-e488-4c1a-b1d5-6f00d89b1231 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: 1cbb606a-06d4-4b05-83a5-cd2db40175c7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:37:14.184112 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3ebff306-e488-4c1a-b1d5-6f00d89b1231 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:14.184555 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3ebff306-e488-4c1a-b1d5-6f00d89b1231 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:14.185342 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3ebff306-e488-4c1a-b1d5-6f00d89b1231 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:14.185820 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3ebff306-e488-4c1a-b1d5-6f00d89b1231 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:14.312064 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3ebff306-e488-4c1a-b1d5-6f00d89b1231 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1536ef9fb14fd78a89b7e350f80946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bbed2f6e14438d8d7ccf6d3b8144b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:37:14.320964 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3ebff306-e488-4c1a-b1d5-6f00d89b1231 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7" status: 200 len: 1319 microversion: 2.1 time: 0.148725 May 17 17:37:14.321526 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 487/1024] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:37:14 2022] GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:37:15.338204 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-91f9899e-57a6-4a45-a636-22528e16efa2 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:37:15.338893 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-91f9899e-57a6-4a45-a636-22528e16efa2 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: 1cbb606a-06d4-4b05-83a5-cd2db40175c7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:37:15.345393 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-91f9899e-57a6-4a45-a636-22528e16efa2 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:15.345830 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-91f9899e-57a6-4a45-a636-22528e16efa2 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:15.346581 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-91f9899e-57a6-4a45-a636-22528e16efa2 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:15.347009 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-91f9899e-57a6-4a45-a636-22528e16efa2 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:15.471437 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-91f9899e-57a6-4a45-a636-22528e16efa2 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1536ef9fb14fd78a89b7e350f80946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bbed2f6e14438d8d7ccf6d3b8144b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:37:15.479236 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-91f9899e-57a6-4a45-a636-22528e16efa2 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7" status: 200 len: 1319 microversion: 2.1 time: 0.145152 May 17 17:37:15.482658 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 538/1025] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:37:15 2022] GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:37:16.496989 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a9cf2879-9fc6-4420-a164-93e75bed6788 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:37:16.497618 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a9cf2879-9fc6-4420-a164-93e75bed6788 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: 1cbb606a-06d4-4b05-83a5-cd2db40175c7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:37:16.503892 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a9cf2879-9fc6-4420-a164-93e75bed6788 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:16.504335 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a9cf2879-9fc6-4420-a164-93e75bed6788 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:16.505086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a9cf2879-9fc6-4420-a164-93e75bed6788 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:16.506155 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a9cf2879-9fc6-4420-a164-93e75bed6788 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:16.632390 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a9cf2879-9fc6-4420-a164-93e75bed6788 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1536ef9fb14fd78a89b7e350f80946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bbed2f6e14438d8d7ccf6d3b8144b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:37:16.639930 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a9cf2879-9fc6-4420-a164-93e75bed6788 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7" status: 200 len: 1507 microversion: 2.1 time: 0.146726 May 17 17:37:16.640486 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 488/1026] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:37:16 2022] GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7 => generated 1507 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:37:16.656394 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e5aa9d0c-447e-43e1-bf87-ef57fd302274 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58e5e5c2-7d00-4d4b-9167-4c9e3ecad2b0", "device": "/dev/sdb"}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:37:16.657516 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e5aa9d0c-447e-43e1-bf87-ef57fd302274 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: 1cbb606a-06d4-4b05-83a5-cd2db40175c7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:37:16.663830 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e5aa9d0c-447e-43e1-bf87-ef57fd302274 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:16.664288 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e5aa9d0c-447e-43e1-bf87-ef57fd302274 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:16.665335 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e5aa9d0c-447e-43e1-bf87-ef57fd302274 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:16.665774 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e5aa9d0c-447e-43e1-bf87-ef57fd302274 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:17.561578 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e5aa9d0c-447e-43e1-bf87-ef57fd302274 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "POST /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.908944 May 17 17:37:17.562198 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 539/1027] 10.222.0.88 () {60 vars in 1322 bytes} [Tue May 17 17:37:16 2022] POST /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7/os-volume_attachments => generated 194 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:37:37.576894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-196799ee-e09c-46ee-9a88-3d0c8b0803ad tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:37:37.577407 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-196799ee-e09c-46ee-9a88-3d0c8b0803ad tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: 1cbb606a-06d4-4b05-83a5-cd2db40175c7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:37:37.583452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-196799ee-e09c-46ee-9a88-3d0c8b0803ad tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:37.583931 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-196799ee-e09c-46ee-9a88-3d0c8b0803ad tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:37.584679 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-196799ee-e09c-46ee-9a88-3d0c8b0803ad tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:37.585106 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-196799ee-e09c-46ee-9a88-3d0c8b0803ad tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:37.712608 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.objects.instance [None req-196799ee-e09c-46ee-9a88-3d0c8b0803ad tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lazy-loading 'services' on Instance uuid 1cbb606a-06d4-4b05-83a5-cd2db40175c7 {{(pid=117611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:37:38.004023 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-196799ee-e09c-46ee-9a88-3d0c8b0803ad tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "DELETE /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7/os-volume_attachments/58e5e5c2-7d00-4d4b-9167-4c9e3ecad2b0" status: 202 len: 0 microversion: 2.1 time: 0.430914 May 17 17:37:38.004627 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 489/1028] 10.222.0.88 () {58 vars in 1415 bytes} [Tue May 17 17:37:37 2022] DELETE /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7/os-volume_attachments/58e5e5c2-7d00-4d4b-9167-4c9e3ecad2b0 => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:37:39.112751 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ab6c88f3-a33c-4a1d-a1cf-8ccd7cc46b4a tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:37:39.113324 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ab6c88f3-a33c-4a1d-a1cf-8ccd7cc46b4a tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: 1cbb606a-06d4-4b05-83a5-cd2db40175c7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:37:39.119345 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ab6c88f3-a33c-4a1d-a1cf-8ccd7cc46b4a tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:39.119826 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ab6c88f3-a33c-4a1d-a1cf-8ccd7cc46b4a tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:39.120591 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ab6c88f3-a33c-4a1d-a1cf-8ccd7cc46b4a tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:39.121021 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ab6c88f3-a33c-4a1d-a1cf-8ccd7cc46b4a tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:39.146647 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ab6c88f3-a33c-4a1d-a1cf-8ccd7cc46b4a tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: 1cbb606a-06d4-4b05-83a5-cd2db40175c7] Going to try to terminate instance {{(pid=117612) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:37:39.467122 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ab6c88f3-a33c-4a1d-a1cf-8ccd7cc46b4a tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "DELETE /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7" status: 204 len: 0 microversion: 2.1 time: 0.358794 May 17 17:37:39.467800 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 540/1029] 10.222.0.88 () {58 vars in 1238 bytes} [Tue May 17 17:37:39 2022] DELETE /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 17 17:37:39.477010 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d40ba4bf-4dc9-4ca4-9fc2-34e08196a924 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:37:39.477740 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d40ba4bf-4dc9-4ca4-9fc2-34e08196a924 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: 1cbb606a-06d4-4b05-83a5-cd2db40175c7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:37:39.483848 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d40ba4bf-4dc9-4ca4-9fc2-34e08196a924 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:39.484299 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d40ba4bf-4dc9-4ca4-9fc2-34e08196a924 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:39.485065 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d40ba4bf-4dc9-4ca4-9fc2-34e08196a924 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:39.485498 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d40ba4bf-4dc9-4ca4-9fc2-34e08196a924 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:39.613308 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d40ba4bf-4dc9-4ca4-9fc2-34e08196a924 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1536ef9fb14fd78a89b7e350f80946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bbed2f6e14438d8d7ccf6d3b8144b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:37:39.620550 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d40ba4bf-4dc9-4ca4-9fc2-34e08196a924 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7" status: 200 len: 1513 microversion: 2.1 time: 0.148232 May 17 17:37:39.621135 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 490/1030] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:37:39 2022] GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:37:40.638827 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-31d4feaf-4fee-42d1-a34b-3945086ddfd8 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:37:40.639464 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-31d4feaf-4fee-42d1-a34b-3945086ddfd8 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: 1cbb606a-06d4-4b05-83a5-cd2db40175c7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:37:40.646306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-31d4feaf-4fee-42d1-a34b-3945086ddfd8 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:40.646759 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-31d4feaf-4fee-42d1-a34b-3945086ddfd8 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:40.647555 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-31d4feaf-4fee-42d1-a34b-3945086ddfd8 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:40.648026 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-31d4feaf-4fee-42d1-a34b-3945086ddfd8 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:40.820943 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-31d4feaf-4fee-42d1-a34b-3945086ddfd8 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1536ef9fb14fd78a89b7e350f80946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bbed2f6e14438d8d7ccf6d3b8144b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:37:40.828172 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-31d4feaf-4fee-42d1-a34b-3945086ddfd8 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7" status: 200 len: 1513 microversion: 2.1 time: 0.193689 May 17 17:37:40.828728 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 541/1031] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:37:40 2022] GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7 => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:37:41.773022 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-47e5d5f8-2026-4290-9270-789bfbf1e831 req-310b53af-26c4-4cf4-bc0f-8feb1509e3f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cbb606a-06d4-4b05-83a5-cd2db40175c7", "name": "network-vif-deleted", "tag": "39914f7e-729f-4d6c-9223-1e0859b34121"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:37:41.781034 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-47e5d5f8-2026-4290-9270-789bfbf1e831 req-310b53af-26c4-4cf4-bc0f-8feb1509e3f7 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:41.781485 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-47e5d5f8-2026-4290-9270-789bfbf1e831 req-310b53af-26c4-4cf4-bc0f-8feb1509e3f7 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:41.792933 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-47e5d5f8-2026-4290-9270-789bfbf1e831 req-310b53af-26c4-4cf4-bc0f-8feb1509e3f7 service nova] Creating event network-vif-deleted:39914f7e-729f-4d6c-9223-1e0859b34121 for instance 1cbb606a-06d4-4b05-83a5-cd2db40175c7 on hv-cinder-84214 May 17 17:37:41.797989 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-47e5d5f8-2026-4290-9270-789bfbf1e831 req-310b53af-26c4-4cf4-bc0f-8feb1509e3f7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083770 May 17 17:37:41.798576 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 491/1032] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:37:41.845396 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-bf5785b4-2848-464b-a860-61f0aa01edb6 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:37:41.846037 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-bf5785b4-2848-464b-a860-61f0aa01edb6 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: 1cbb606a-06d4-4b05-83a5-cd2db40175c7] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:37:41.852259 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bf5785b4-2848-464b-a860-61f0aa01edb6 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:41.854432 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bf5785b4-2848-464b-a860-61f0aa01edb6 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:41.854432 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bf5785b4-2848-464b-a860-61f0aa01edb6 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:41.854432 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bf5785b4-2848-464b-a860-61f0aa01edb6 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:41.916984 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-bf5785b4-2848-464b-a860-61f0aa01edb6 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1536ef9fb14fd78a89b7e350f80946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bbed2f6e14438d8d7ccf6d3b8144b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:37:41.924524 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-bf5785b4-2848-464b-a860-61f0aa01edb6 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7" status: 200 len: 1471 microversion: 2.1 time: 0.082885 May 17 17:37:41.925097 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 542/1033] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:37:41 2022] GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7 => generated 1471 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:37:42.943145 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3e05a0b1-2f12-4a4b-b05a-d385134e40c2 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:37:42.943917 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3e05a0b1-2f12-4a4b-b05a-d385134e40c2 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] [instance: 1cbb606a-06d4-4b05-83a5-cd2db40175c7] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:37:42.950052 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3e05a0b1-2f12-4a4b-b05a-d385134e40c2 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:42.950518 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3e05a0b1-2f12-4a4b-b05a-d385134e40c2 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:42.951259 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3e05a0b1-2f12-4a4b-b05a-d385134e40c2 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:37:42.951733 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3e05a0b1-2f12-4a4b-b05a-d385134e40c2 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:37:42.964440 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-3e05a0b1-2f12-4a4b-b05a-d385134e40c2 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] HTTP exception thrown: Instance 1cbb606a-06d4-4b05-83a5-cd2db40175c7 could not be found. May 17 17:37:42.966012 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3e05a0b1-2f12-4a4b-b05a-d385134e40c2 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Request method failure captured: May 17 17:37:42.966012 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7 HTTP/1.1 May 17 17:37:42.966012 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:37:42.966012 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:37:42.966012 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:37:42.966012 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:37:42.966012 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:37:42.966012 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:37:42.966012 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:37:42.966012 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:37:42.966012 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig9z4EYaE1jWFy8R9_zOiDepbHhm0eX8vX9WH37DTrMOq0NwO9g5VxAZUrMIqhLEruJpwKVW0lmxbYdceUtfOzkBwFNOt2JsnX4n42eAQ1q1YxE-fEw01WCYVNmEIH_OBNGBycbDTyNwZS2sRQxmeTQ83Zn9BbzQGxr6UlRECknDeijg May 17 17:37:42.966012 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:37:42.966012 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:37:42.966012 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:37:42.966012 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:37:42.966012 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:37:42.966012 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:37:42.966012 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: b8bbed2f6e14438d8d7ccf6d3b8144b4 May 17 17:37:42.966012 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1144118160 May 17 17:37:42.966012 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:37:42.966012 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:37:42.967601 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b8bbed2f6e14438d8d7ccf6d3b8144b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b8bbed2f6e14438d8d7ccf6d3b8144b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b8bbed2f6e14438d8d7ccf6d3b8144b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b8bbed2f6e14438d8d7ccf6d3b8144b4", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:37:42.967601 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-VolumesSnapshotTestJSON-1144118160 May 17 17:37:42.967601 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: b8bbed2f6e14438d8d7ccf6d3b8144b4 May 17 17:37:42.967601 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1144118160 May 17 17:37:42.967601 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-VolumesSnapshotTestJSON-1144118160-project May 17 17:37:42.967601 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:37:42.967601 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:37:42.967601 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 5a1536ef9fb14fd78a89b7e350f80946 May 17 17:37:42.967601 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-VolumesSnapshotTestJSON-1144118160-project May 17 17:37:42.967601 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:37:42.967601 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Instance 1cbb606a-06d4-4b05-83a5-cd2db40175c7 could not be found. May 17 17:37:42.967601 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': '1cbb606a-06d4-4b05-83a5-cd2db40175c7'} May 17 17:37:42.968516 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:37:42.968516 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:37:42.968516 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:37:42.968516 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:37:42.968516 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:37:42.968516 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:37:42.968516 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:37:42.968516 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:37:42.968516 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:37:42.968516 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:37:42.968516 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cbb606a-06d4-4b05-83a5-cd2db40175c7 could not be found. May 17 17:37:42.968516 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:37:42.968516 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:37:42.968516 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:37:42.968516 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:37:42.968516 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:37:42.968516 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:37:42.968516 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:37:42.968516 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:37:42.968516 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:37:42.970105 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:37:42.970105 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:37:42.970105 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:37:42.970105 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:37:42.970105 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:37:42.970105 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:37:42.970105 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:37:42.970105 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cbb606a-06d4-4b05-83a5-cd2db40175c7 could not be found. May 17 17:37:42.970105 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:37:42.970105 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:37:42.970105 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:37:42.970105 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:37:42.970105 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:37:42.970105 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:37:42.970105 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:37:42.970105 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:37:42.970105 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cbb606a-06d4-4b05-83a5-cd2db40175c7 could not be found. May 17 17:37:42.970105 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:37:42.971700 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3e05a0b1-2f12-4a4b-b05a-d385134e40c2 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] Returning 404 to user: Instance 1cbb606a-06d4-4b05-83a5-cd2db40175c7 could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:37:42.971700 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3e05a0b1-2f12-4a4b-b05a-d385134e40c2 tempest-VolumesSnapshotTestJSON-1144118160 tempest-VolumesSnapshotTestJSON-1144118160-project] 10.222.0.88 "GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7" status: 404 len: 111 microversion: 2.1 time: 0.029553 May 17 17:37:42.971700 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 492/1034] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:37:42 2022] GET /compute/v2.1/servers/1cbb606a-06d4-4b05-83a5-cd2db40175c7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:38:34.125178 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2109c2b8-5a47-464d-9eb4-3b1dea1d468a tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Action: 'create', calling method: .version_select at 0x7f73d4927ee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-456264398", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6ZLiszdlpxLIzSStH1BJeyTv91do7tvM7EpOtho0xDccRyh4z/X1+yzWyHuCEFvcXUOiAxmejPOfPAZK/or60xrjia9GCEGRAkT7S6PXVrLJ4jZdkfF1qZ0vfwCuz4xA=="}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:38:34.138714 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-2109c2b8-5a47-464d-9eb4-3b1dea1d468a tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Getting quotas for project ca1ed85649da40dd85a30986f4837161. Resources: {'key_pairs'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:38:34.142469 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-2109c2b8-5a47-464d-9eb4-3b1dea1d468a tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Getting quotas for user 71c7edd9b03e4b389ab09c0ac3a366e4 and project ca1ed85649da40dd85a30986f4837161. Resources: {'key_pairs'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:38:34.153687 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2109c2b8-5a47-464d-9eb4-3b1dea1d468a tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [25141c2d-c5e2-46b5-96ee-ba8de54971d9] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 17 17:38:35.160959 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO oslo.messaging._drivers.impl_rabbit [None req-2109c2b8-5a47-464d-9eb4-3b1dea1d468a tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [25141c2d-c5e2-46b5-96ee-ba8de54971d9] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 40536. May 17 17:38:35.226995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2109c2b8-5a47-464d-9eb4-3b1dea1d468a tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 1.106235 May 17 17:38:35.227615 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 543/1035] 10.222.0.88 () {60 vars in 1158 bytes} [Tue May 17 17:38:34 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:38:35.275059 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ec74cc31-b69a-48a6-9955-1d75f5a1a5ae tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-333175946", "imageRef": "14d3a0e4-c2e6-4a64-80a4-dac163bc667d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-456264398", "networks": [{"uuid": "4511a4f1-24f7-465d-8393-221c30277cb8"}]}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:38:35.323822 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.network.neutron [None req-ec74cc31-b69a-48a6-9955-1d75f5a1a5ae tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] validate_networks() for [('4511a4f1-24f7-465d-8393-221c30277cb8', None, None, None, None, None)] {{(pid=117611) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 17:38:35.769269 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-ec74cc31-b69a-48a6-9955-1d75f5a1a5ae tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Flavor limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 17:38:35.769691 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-ec74cc31-b69a-48a6-9955-1d75f5a1a5ae tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Image limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 17:38:35.770160 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-ec74cc31-b69a-48a6-9955-1d75f5a1a5ae tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Flavor pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 17:38:35.770566 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-ec74cc31-b69a-48a6-9955-1d75f5a1a5ae tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Image pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 17:38:35.771003 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-ec74cc31-b69a-48a6-9955-1d75f5a1a5ae tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 17:38:35.779368 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ec74cc31-b69a-48a6-9955-1d75f5a1a5ae tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:35.779851 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ec74cc31-b69a-48a6-9955-1d75f5a1a5ae tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:35.781160 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ec74cc31-b69a-48a6-9955-1d75f5a1a5ae tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:35.781591 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ec74cc31-b69a-48a6-9955-1d75f5a1a5ae tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:35.798090 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-ec74cc31-b69a-48a6-9955-1d75f5a1a5ae tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Getting quotas for project ca1ed85649da40dd85a30986f4837161. Resources: {'cores', 'ram', 'instances'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 17:38:35.801939 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-ec74cc31-b69a-48a6-9955-1d75f5a1a5ae tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Getting quotas for user 71c7edd9b03e4b389ab09c0ac3a366e4 and project ca1ed85649da40dd85a30986f4837161. Resources: {'cores', 'ram', 'instances'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 17:38:35.812338 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ec74cc31-b69a-48a6-9955-1d75f5a1a5ae tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Going to run 1 instances... {{(pid=117611) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 17:38:35.814468 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ec74cc31-b69a-48a6-9955-1d75f5a1a5ae tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14d3a0e4-c2e6-4a64-80a4-dac163bc667d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 17:38:35.947956 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ec74cc31-b69a-48a6-9955-1d75f5a1a5ae tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.676639 May 17 17:38:35.948585 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 493/1036] 10.222.0.88 () {60 vars in 1146 bytes} [Tue May 17 17:38:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 17:38:35.958155 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f312afe8-81f0-4b83-a74b-07a926c41b7b tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:38:35.958776 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f312afe8-81f0-4b83-a74b-07a926c41b7b tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:38:36.010090 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f312afe8-81f0-4b83-a74b-07a926c41b7b tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:38:36.017784 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f312afe8-81f0-4b83-a74b-07a926c41b7b tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1257 microversion: 2.1 time: 0.063310 May 17 17:38:36.018271 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 544/1037] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:38:35 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1257 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:38:37.034665 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5a6f600c-55b3-4a45-9685-9aa8b965e45c tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:38:37.035304 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-5a6f600c-55b3-4a45-9685-9aa8b965e45c tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:38:37.090848 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-5a6f600c-55b3-4a45-9685-9aa8b965e45c tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:38:37.097499 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5a6f600c-55b3-4a45-9685-9aa8b965e45c tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1257 microversion: 2.1 time: 0.067280 May 17 17:38:37.098048 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 494/1038] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:38:37 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:38:38.114181 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e7483239-4a91-4923-a7e3-04973de06e09 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:38:38.114789 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e7483239-4a91-4923-a7e3-04973de06e09 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:38:38.166411 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e7483239-4a91-4923-a7e3-04973de06e09 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:38:38.173028 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e7483239-4a91-4923-a7e3-04973de06e09 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1257 microversion: 2.1 time: 0.062716 May 17 17:38:38.173591 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 545/1039] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:38:38 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1257 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:38:39.190053 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ee1e0c11-25e9-46f7-a820-7a50710c0433 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:38:39.190672 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ee1e0c11-25e9-46f7-a820-7a50710c0433 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:38:39.241223 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ee1e0c11-25e9-46f7-a820-7a50710c0433 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:38:39.247973 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ee1e0c11-25e9-46f7-a820-7a50710c0433 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1257 microversion: 2.1 time: 0.061727 May 17 17:38:39.248526 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 495/1040] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:38:39 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1257 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:38:40.265229 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-afd56143-f84e-4070-9820-e86b6819f0a5 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:38:40.265764 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-afd56143-f84e-4070-9820-e86b6819f0a5 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:38:40.273164 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-afd56143-f84e-4070-9820-e86b6819f0a5 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:40.273608 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-afd56143-f84e-4070-9820-e86b6819f0a5 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:40.274365 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-afd56143-f84e-4070-9820-e86b6819f0a5 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:40.274798 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-afd56143-f84e-4070-9820-e86b6819f0a5 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:40.334056 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-afd56143-f84e-4070-9820-e86b6819f0a5 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:38:40.341263 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-afd56143-f84e-4070-9820-e86b6819f0a5 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1261 microversion: 2.1 time: 0.079937 May 17 17:38:40.341809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 546/1041] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:38:40 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1261 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:38:41.358004 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7127d530-56c0-477e-9d92-e57af57396fa tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:38:41.358615 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-7127d530-56c0-477e-9d92-e57af57396fa tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:38:41.365607 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7127d530-56c0-477e-9d92-e57af57396fa tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:41.366055 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7127d530-56c0-477e-9d92-e57af57396fa tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:41.366821 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7127d530-56c0-477e-9d92-e57af57396fa tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:41.367255 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7127d530-56c0-477e-9d92-e57af57396fa tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:41.428525 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7127d530-56c0-477e-9d92-e57af57396fa tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:38:41.435745 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-7127d530-56c0-477e-9d92-e57af57396fa tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1261 microversion: 2.1 time: 0.081682 May 17 17:38:41.436297 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 496/1042] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:38:41 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1261 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:38:42.452409 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5ddee5d0-92c9-4d80-99dd-f055b4b268dc tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:38:42.453120 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5ddee5d0-92c9-4d80-99dd-f055b4b268dc tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:38:42.459403 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5ddee5d0-92c9-4d80-99dd-f055b4b268dc tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:42.459962 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5ddee5d0-92c9-4d80-99dd-f055b4b268dc tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:42.460802 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5ddee5d0-92c9-4d80-99dd-f055b4b268dc tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:42.461312 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5ddee5d0-92c9-4d80-99dd-f055b4b268dc tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:42.534431 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5ddee5d0-92c9-4d80-99dd-f055b4b268dc tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:38:42.542728 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5ddee5d0-92c9-4d80-99dd-f055b4b268dc tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1317 microversion: 2.1 time: 0.094160 May 17 17:38:42.543300 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 547/1043] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:38:42 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1317 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:38:43.563910 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-47db9f4d-8389-4bc1-aae4-4746a14fcc67 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:38:43.565101 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-47db9f4d-8389-4bc1-aae4-4746a14fcc67 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:38:43.573111 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-47db9f4d-8389-4bc1-aae4-4746a14fcc67 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:43.573816 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-47db9f4d-8389-4bc1-aae4-4746a14fcc67 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:43.574913 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-47db9f4d-8389-4bc1-aae4-4746a14fcc67 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:43.575634 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-47db9f4d-8389-4bc1-aae4-4746a14fcc67 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:43.865907 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-47db9f4d-8389-4bc1-aae4-4746a14fcc67 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:38:43.876236 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-47db9f4d-8389-4bc1-aae4-4746a14fcc67 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1357 microversion: 2.1 time: 0.316123 May 17 17:38:43.889158 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 497/1044] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:38:43 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1357 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:38:44.604879 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-12e09cf3-0d74-47c3-8205-2e7d3c8a6e02 req-d8c9aa9f-9006-4dd7-bba9-c651bb5450a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84d4ef76-c06a-46c3-935a-925bf977545f", "tag": "886f7c81-7ed2-4be0-9716-220ee11c6e8c"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:38:44.620611 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-12e09cf3-0d74-47c3-8205-2e7d3c8a6e02 req-d8c9aa9f-9006-4dd7-bba9-c651bb5450a6 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:44.621337 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-12e09cf3-0d74-47c3-8205-2e7d3c8a6e02 req-d8c9aa9f-9006-4dd7-bba9-c651bb5450a6 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:44.640585 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-12e09cf3-0d74-47c3-8205-2e7d3c8a6e02 req-d8c9aa9f-9006-4dd7-bba9-c651bb5450a6 service nova] Creating event network-changed:886f7c81-7ed2-4be0-9716-220ee11c6e8c for instance 84d4ef76-c06a-46c3-935a-925bf977545f on hv-cinder-84214 May 17 17:38:44.647140 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-12e09cf3-0d74-47c3-8205-2e7d3c8a6e02 req-d8c9aa9f-9006-4dd7-bba9-c651bb5450a6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046924 May 17 17:38:44.648843 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 548/1045] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:38:44.894153 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b93321ce-a348-469f-993a-80c91747ac2d tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:38:44.894783 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b93321ce-a348-469f-993a-80c91747ac2d tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:38:44.902222 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b93321ce-a348-469f-993a-80c91747ac2d tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:44.902965 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b93321ce-a348-469f-993a-80c91747ac2d tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:44.903939 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b93321ce-a348-469f-993a-80c91747ac2d tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:44.904535 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b93321ce-a348-469f-993a-80c91747ac2d tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:45.043374 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b93321ce-a348-469f-993a-80c91747ac2d tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:38:45.052774 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b93321ce-a348-469f-993a-80c91747ac2d tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1357 microversion: 2.1 time: 0.162570 May 17 17:38:45.053664 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 498/1046] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:38:44 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:38:46.070028 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4f2f64a8-112c-4409-9991-71ed47d4cb9d tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:38:46.071917 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4f2f64a8-112c-4409-9991-71ed47d4cb9d tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:38:46.079233 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4f2f64a8-112c-4409-9991-71ed47d4cb9d tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:46.080079 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4f2f64a8-112c-4409-9991-71ed47d4cb9d tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:46.081457 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4f2f64a8-112c-4409-9991-71ed47d4cb9d tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:46.082113 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4f2f64a8-112c-4409-9991-71ed47d4cb9d tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:46.219857 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4f2f64a8-112c-4409-9991-71ed47d4cb9d tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:38:46.227586 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4f2f64a8-112c-4409-9991-71ed47d4cb9d tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1357 microversion: 2.1 time: 0.161803 May 17 17:38:46.228138 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 549/1047] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:38:46 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:38:47.245739 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a42317e1-8423-4307-8508-c0f23684ee1a tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:38:47.247419 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a42317e1-8423-4307-8508-c0f23684ee1a tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:38:47.254093 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a42317e1-8423-4307-8508-c0f23684ee1a tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:47.255213 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a42317e1-8423-4307-8508-c0f23684ee1a tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:47.256016 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a42317e1-8423-4307-8508-c0f23684ee1a tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:47.256450 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a42317e1-8423-4307-8508-c0f23684ee1a tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:47.394295 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a42317e1-8423-4307-8508-c0f23684ee1a tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:38:47.402087 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a42317e1-8423-4307-8508-c0f23684ee1a tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1357 microversion: 2.1 time: 0.161061 May 17 17:38:47.402656 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 499/1048] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:38:47 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:38:48.418889 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-73170be3-90e3-41da-ac94-471feddd4593 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:38:48.419541 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-73170be3-90e3-41da-ac94-471feddd4593 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:38:48.427327 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-73170be3-90e3-41da-ac94-471feddd4593 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:48.427940 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-73170be3-90e3-41da-ac94-471feddd4593 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:48.428885 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-73170be3-90e3-41da-ac94-471feddd4593 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:48.429375 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-73170be3-90e3-41da-ac94-471feddd4593 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:48.573264 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-73170be3-90e3-41da-ac94-471feddd4593 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:38:48.580522 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-73170be3-90e3-41da-ac94-471feddd4593 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1357 microversion: 2.1 time: 0.165698 May 17 17:38:48.581074 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 550/1049] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:38:48 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:38:49.597298 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-081fc69c-aa8a-40d9-8659-a1ddccd754bc tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:38:49.597896 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-081fc69c-aa8a-40d9-8659-a1ddccd754bc tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:38:49.604998 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-081fc69c-aa8a-40d9-8659-a1ddccd754bc tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:49.605472 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-081fc69c-aa8a-40d9-8659-a1ddccd754bc tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:49.606239 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-081fc69c-aa8a-40d9-8659-a1ddccd754bc tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:49.606676 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-081fc69c-aa8a-40d9-8659-a1ddccd754bc tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:49.757445 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-081fc69c-aa8a-40d9-8659-a1ddccd754bc tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:38:49.764801 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-081fc69c-aa8a-40d9-8659-a1ddccd754bc tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1357 microversion: 2.1 time: 0.171425 May 17 17:38:49.767200 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 500/1050] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:38:49 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:38:50.782136 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d3803146-4b4e-4d79-a47b-f8766980c859 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:38:50.782784 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d3803146-4b4e-4d79-a47b-f8766980c859 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:38:50.789570 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d3803146-4b4e-4d79-a47b-f8766980c859 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:50.790289 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d3803146-4b4e-4d79-a47b-f8766980c859 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:50.791053 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d3803146-4b4e-4d79-a47b-f8766980c859 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:50.791494 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d3803146-4b4e-4d79-a47b-f8766980c859 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:50.928457 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d3803146-4b4e-4d79-a47b-f8766980c859 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:38:50.935767 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d3803146-4b4e-4d79-a47b-f8766980c859 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1357 microversion: 2.1 time: 0.157449 May 17 17:38:50.936327 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 551/1051] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:38:50 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:38:51.952657 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3626b980-9912-4dcd-8997-79708373f71f tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:38:51.953373 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3626b980-9912-4dcd-8997-79708373f71f tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:38:51.959675 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3626b980-9912-4dcd-8997-79708373f71f tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:51.960123 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3626b980-9912-4dcd-8997-79708373f71f tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:51.960890 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3626b980-9912-4dcd-8997-79708373f71f tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:51.961317 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3626b980-9912-4dcd-8997-79708373f71f tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:52.150420 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3626b980-9912-4dcd-8997-79708373f71f tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:38:52.157785 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3626b980-9912-4dcd-8997-79708373f71f tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1357 microversion: 2.1 time: 0.208951 May 17 17:38:52.158354 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 501/1052] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:38:51 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1357 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:38:53.175558 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-41690f04-5e8b-46f4-a07c-8bad670ffef8 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:38:53.176196 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-41690f04-5e8b-46f4-a07c-8bad670ffef8 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:38:53.183177 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-41690f04-5e8b-46f4-a07c-8bad670ffef8 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:53.183678 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-41690f04-5e8b-46f4-a07c-8bad670ffef8 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:53.184436 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-41690f04-5e8b-46f4-a07c-8bad670ffef8 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:53.184869 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-41690f04-5e8b-46f4-a07c-8bad670ffef8 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:53.308133 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-41690f04-5e8b-46f4-a07c-8bad670ffef8 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:38:53.315389 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-41690f04-5e8b-46f4-a07c-8bad670ffef8 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1357 microversion: 2.1 time: 0.143709 May 17 17:38:53.315985 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 552/1053] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:38:53 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1357 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:38:54.332932 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-131bbd58-71b5-4e6a-8171-f988bcdd82c0 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:38:54.334153 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-131bbd58-71b5-4e6a-8171-f988bcdd82c0 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:38:54.340421 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-131bbd58-71b5-4e6a-8171-f988bcdd82c0 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:54.340866 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-131bbd58-71b5-4e6a-8171-f988bcdd82c0 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:54.341616 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-131bbd58-71b5-4e6a-8171-f988bcdd82c0 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:54.342049 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-131bbd58-71b5-4e6a-8171-f988bcdd82c0 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:54.470011 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-131bbd58-71b5-4e6a-8171-f988bcdd82c0 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:38:54.477455 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-131bbd58-71b5-4e6a-8171-f988bcdd82c0 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1357 microversion: 2.1 time: 0.148480 May 17 17:38:54.478016 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 502/1054] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:38:54 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:38:55.494268 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-60aa05e3-8487-494d-a6e0-4c5d766313e6 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:38:55.494869 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-60aa05e3-8487-494d-a6e0-4c5d766313e6 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:38:55.501355 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-60aa05e3-8487-494d-a6e0-4c5d766313e6 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:55.501849 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-60aa05e3-8487-494d-a6e0-4c5d766313e6 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:55.502641 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-60aa05e3-8487-494d-a6e0-4c5d766313e6 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:55.503082 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-60aa05e3-8487-494d-a6e0-4c5d766313e6 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:55.641305 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-60aa05e3-8487-494d-a6e0-4c5d766313e6 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:38:55.642742 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-60aa05e3-8487-494d-a6e0-4c5d766313e6 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1357 microversion: 2.1 time: 0.152257 May 17 17:38:55.643353 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 553/1055] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:38:55 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:38:56.624311 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-70b33281-0148-425e-bab8-f8771434cd36 req-90a68d3d-0d96-4a15-b71f-d67cf2b693ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84d4ef76-c06a-46c3-935a-925bf977545f", "name": "network-vif-plugged", "status": "completed", "tag": "886f7c81-7ed2-4be0-9716-220ee11c6e8c"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:38:56.632468 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-70b33281-0148-425e-bab8-f8771434cd36 req-90a68d3d-0d96-4a15-b71f-d67cf2b693ae service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:56.634538 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-70b33281-0148-425e-bab8-f8771434cd36 req-90a68d3d-0d96-4a15-b71f-d67cf2b693ae service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:56.644428 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-70b33281-0148-425e-bab8-f8771434cd36 req-90a68d3d-0d96-4a15-b71f-d67cf2b693ae service nova] Creating event network-vif-plugged:886f7c81-7ed2-4be0-9716-220ee11c6e8c for instance 84d4ef76-c06a-46c3-935a-925bf977545f on hv-cinder-84214 May 17 17:38:56.649434 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-70b33281-0148-425e-bab8-f8771434cd36 req-90a68d3d-0d96-4a15-b71f-d67cf2b693ae service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029132 May 17 17:38:56.650006 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 503/1056] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:38:56.659431 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-eaf4179f-808b-4cad-9a97-517ed5185617 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:38:56.660066 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-eaf4179f-808b-4cad-9a97-517ed5185617 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:38:56.667486 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eaf4179f-808b-4cad-9a97-517ed5185617 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:56.668000 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eaf4179f-808b-4cad-9a97-517ed5185617 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:56.668844 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eaf4179f-808b-4cad-9a97-517ed5185617 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:56.669303 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eaf4179f-808b-4cad-9a97-517ed5185617 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:56.800411 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-eaf4179f-808b-4cad-9a97-517ed5185617 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:38:56.808272 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-eaf4179f-808b-4cad-9a97-517ed5185617 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1357 microversion: 2.1 time: 0.152683 May 17 17:38:56.808836 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 554/1057] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:38:56 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:38:57.826086 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ee389877-75ed-48db-abab-7e8e1045a58e tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:38:57.826688 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ee389877-75ed-48db-abab-7e8e1045a58e tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:38:57.832770 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ee389877-75ed-48db-abab-7e8e1045a58e tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:57.833267 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ee389877-75ed-48db-abab-7e8e1045a58e tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:57.834016 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ee389877-75ed-48db-abab-7e8e1045a58e tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:57.834447 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ee389877-75ed-48db-abab-7e8e1045a58e tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:57.958260 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ee389877-75ed-48db-abab-7e8e1045a58e tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:38:57.965482 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ee389877-75ed-48db-abab-7e8e1045a58e tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1357 microversion: 2.1 time: 0.144138 May 17 17:38:57.966050 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 504/1058] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:38:57 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1357 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:38:58.987447 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-05b3b0e5-c699-4ba8-aad2-75074e83ac02 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:38:58.988104 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-05b3b0e5-c699-4ba8-aad2-75074e83ac02 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:38:58.994911 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-05b3b0e5-c699-4ba8-aad2-75074e83ac02 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:58.995354 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-05b3b0e5-c699-4ba8-aad2-75074e83ac02 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:58.996171 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-05b3b0e5-c699-4ba8-aad2-75074e83ac02 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:58.996632 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-05b3b0e5-c699-4ba8-aad2-75074e83ac02 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:59.124995 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-05b3b0e5-c699-4ba8-aad2-75074e83ac02 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:38:59.132228 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-05b3b0e5-c699-4ba8-aad2-75074e83ac02 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1547 microversion: 2.1 time: 0.148562 May 17 17:38:59.132782 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 555/1059] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:38:58 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:38:59.148426 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-88a507e4-7a65-40d7-8ac8-9588da97c496 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:38:59.149032 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-88a507e4-7a65-40d7-8ac8-9588da97c496 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:38:59.155180 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-88a507e4-7a65-40d7-8ac8-9588da97c496 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:59.155672 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-88a507e4-7a65-40d7-8ac8-9588da97c496 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:59.156429 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-88a507e4-7a65-40d7-8ac8-9588da97c496 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:59.156859 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-88a507e4-7a65-40d7-8ac8-9588da97c496 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:59.280638 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-88a507e4-7a65-40d7-8ac8-9588da97c496 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:38:59.288419 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-88a507e4-7a65-40d7-8ac8-9588da97c496 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1547 microversion: 2.1 time: 0.144251 May 17 17:38:59.288970 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 505/1060] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:38:59 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1547 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:38:59.303946 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-53f2c8f3-9fe5-4519-812d-168813130bfd tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:38:59.307296 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-53f2c8f3-9fe5-4519-812d-168813130bfd tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:38:59.308076 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-53f2c8f3-9fe5-4519-812d-168813130bfd tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Searching by: {'deleted': False, 'project_id': 'ca1ed85649da40dd85a30986f4837161'} {{(pid=117612) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 17 17:38:59.314592 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-53f2c8f3-9fe5-4519-812d-168813130bfd tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:59.315035 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-53f2c8f3-9fe5-4519-812d-168813130bfd tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:59.315844 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-53f2c8f3-9fe5-4519-812d-168813130bfd tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:59.316276 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-53f2c8f3-9fe5-4519-812d-168813130bfd tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:59.401927 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.multi_cell_list [None req-53f2c8f3-9fe5-4519-812d-168813130bfd tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117612) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 17 17:38:59.652618 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-53f2c8f3-9fe5-4519-812d-168813130bfd tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.352263 May 17 17:38:59.657100 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 556/1061] 10.222.0.88 () {58 vars in 1124 bytes} [Tue May 17 17:38:59 2022] GET /compute/v2.1/servers => generated 342 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:38:59.663679 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1870b77c-28fd-47eb-8c43-b235a135d5fa tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:38:59.664317 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1870b77c-28fd-47eb-8c43-b235a135d5fa tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:38:59.670484 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1870b77c-28fd-47eb-8c43-b235a135d5fa tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:59.670928 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1870b77c-28fd-47eb-8c43-b235a135d5fa tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:59.671726 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1870b77c-28fd-47eb-8c43-b235a135d5fa tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:38:59.672160 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1870b77c-28fd-47eb-8c43-b235a135d5fa tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:38:59.799766 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-1870b77c-28fd-47eb-8c43-b235a135d5fa tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:38:59.807179 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1870b77c-28fd-47eb-8c43-b235a135d5fa tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1547 microversion: 2.1 time: 0.147307 May 17 17:38:59.807772 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 506/1062] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:38:59 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1547 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:39:01.833618 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-19a214d1-65e0-4557-9456-7c9ae21331c5 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b097fd3-1537-44e3-80d5-5d5d262d29c4"}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:39:01.835238 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-19a214d1-65e0-4557-9456-7c9ae21331c5 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:39:01.841454 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-19a214d1-65e0-4557-9456-7c9ae21331c5 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:01.841906 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-19a214d1-65e0-4557-9456-7c9ae21331c5 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:01.842672 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-19a214d1-65e0-4557-9456-7c9ae21331c5 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:01.843107 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-19a214d1-65e0-4557-9456-7c9ae21331c5 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:02.646992 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-19a214d1-65e0-4557-9456-7c9ae21331c5 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "POST /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.816625 May 17 17:39:02.650185 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 557/1063] 10.222.0.88 () {60 vars in 1322 bytes} [Tue May 17 17:39:01 2022] POST /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f/os-volume_attachments => generated 194 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:39:10.159412 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-98108afd-a83c-4d03-8150-165d5512392c tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:39:10.160038 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-98108afd-a83c-4d03-8150-165d5512392c tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:39:10.166673 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-98108afd-a83c-4d03-8150-165d5512392c tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:10.167123 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-98108afd-a83c-4d03-8150-165d5512392c tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:10.167925 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-98108afd-a83c-4d03-8150-165d5512392c tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:10.168356 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-98108afd-a83c-4d03-8150-165d5512392c tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:10.290382 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-98108afd-a83c-4d03-8150-165d5512392c tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:39:10.298101 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-98108afd-a83c-4d03-8150-165d5512392c tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1593 microversion: 2.1 time: 0.142451 May 17 17:39:10.298662 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 507/1064] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:39:10 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1593 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:39:12.441705 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-115b758b-7035-4fab-b90b-7591f8acc69e req-69495aa8-edc5-43f7-bc00-96f4de913683 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84d4ef76-c06a-46c3-935a-925bf977545f", "tag": "886f7c81-7ed2-4be0-9716-220ee11c6e8c"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:39:12.450453 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-115b758b-7035-4fab-b90b-7591f8acc69e req-69495aa8-edc5-43f7-bc00-96f4de913683 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:12.450903 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-115b758b-7035-4fab-b90b-7591f8acc69e req-69495aa8-edc5-43f7-bc00-96f4de913683 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:12.461510 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-115b758b-7035-4fab-b90b-7591f8acc69e req-69495aa8-edc5-43f7-bc00-96f4de913683 service nova] Creating event network-changed:886f7c81-7ed2-4be0-9716-220ee11c6e8c for instance 84d4ef76-c06a-46c3-935a-925bf977545f on hv-cinder-84214 May 17 17:39:12.466660 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-115b758b-7035-4fab-b90b-7591f8acc69e req-69495aa8-edc5-43f7-bc00-96f4de913683 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029917 May 17 17:39:12.467246 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 558/1065] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:39:15.097981 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c23f0c8d-d731-461e-86e6-35d66d8cd8a9 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1320874333"}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:39:15.098522 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c23f0c8d-d731-461e-86e6-35d66d8cd8a9 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:39:15.104880 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c23f0c8d-d731-461e-86e6-35d66d8cd8a9 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:15.105333 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c23f0c8d-d731-461e-86e6-35d66d8cd8a9 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:15.106099 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c23f0c8d-d731-461e-86e6-35d66d8cd8a9 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:15.106537 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c23f0c8d-d731-461e-86e6-35d66d8cd8a9 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:15.229433 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.network.security_group_api [None req-c23f0c8d-d731-461e-86e6-35d66d8cd8a9 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Adding security group d90055b2-1fb0-4e55-bd2a-3053d66d7837 to port 886f7c81-7ed2-4be0-9716-220ee11c6e8c May 17 17:39:15.654777 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c23f0c8d-d731-461e-86e6-35d66d8cd8a9 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "POST /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f/action" status: 202 len: 0 microversion: 2.1 time: 0.560783 May 17 17:39:15.656267 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 508/1066] 10.222.0.88 () {60 vars in 1277 bytes} [Tue May 17 17:39:15 2022] POST /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f/action => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:39:15.666280 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-dbffce76-9b05-4a41-9d9a-4f50c818b3e3 req-cd0e2c74-b605-46ec-a1e5-e130bb6b968b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84d4ef76-c06a-46c3-935a-925bf977545f", "tag": "886f7c81-7ed2-4be0-9716-220ee11c6e8c"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:39:15.671150 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1d6d008b-1fde-49e9-8dee-7bd1d1244c71 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:39:15.671150 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1d6d008b-1fde-49e9-8dee-7bd1d1244c71 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:39:15.676084 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-dbffce76-9b05-4a41-9d9a-4f50c818b3e3 req-cd0e2c74-b605-46ec-a1e5-e130bb6b968b service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:15.676826 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-dbffce76-9b05-4a41-9d9a-4f50c818b3e3 req-cd0e2c74-b605-46ec-a1e5-e130bb6b968b service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:15.685586 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1d6d008b-1fde-49e9-8dee-7bd1d1244c71 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:15.686330 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1d6d008b-1fde-49e9-8dee-7bd1d1244c71 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:15.687486 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1d6d008b-1fde-49e9-8dee-7bd1d1244c71 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:15.689116 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1d6d008b-1fde-49e9-8dee-7bd1d1244c71 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:15.691432 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-dbffce76-9b05-4a41-9d9a-4f50c818b3e3 req-cd0e2c74-b605-46ec-a1e5-e130bb6b968b service nova] Creating event network-changed:886f7c81-7ed2-4be0-9716-220ee11c6e8c for instance 84d4ef76-c06a-46c3-935a-925bf977545f on hv-cinder-84214 May 17 17:39:15.699840 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-dbffce76-9b05-4a41-9d9a-4f50c818b3e3 req-cd0e2c74-b605-46ec-a1e5-e130bb6b968b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037850 May 17 17:39:15.701155 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 509/1067] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:39:15.945503 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1d6d008b-1fde-49e9-8dee-7bd1d1244c71 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:39:15.953495 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1d6d008b-1fde-49e9-8dee-7bd1d1244c71 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1759 microversion: 2.1 time: 0.291515 May 17 17:39:15.954173 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 559/1068] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:39:15 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1759 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:39:24.367336 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 17:39:24.367882 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Tue May 17 17:39:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 17:39:38.705474 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ababe54e-517f-41f3-9aab-eecacf4177f9 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:39:38.706511 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ababe54e-517f-41f3-9aab-eecacf4177f9 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:39:38.712897 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ababe54e-517f-41f3-9aab-eecacf4177f9 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:38.713357 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ababe54e-517f-41f3-9aab-eecacf4177f9 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:38.714156 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ababe54e-517f-41f3-9aab-eecacf4177f9 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:38.714595 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ababe54e-517f-41f3-9aab-eecacf4177f9 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:38.999283 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ababe54e-517f-41f3-9aab-eecacf4177f9 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "POST /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f/action" status: 202 len: 0 microversion: 2.1 time: 0.297892 May 17 17:39:39.000097 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 510/1069] 10.222.0.88 () {60 vars in 1277 bytes} [Tue May 17 17:39:38 2022] POST /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:39:39.008993 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e4d52d00-6a7b-4b04-973b-4a91a1e83397 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:39:39.009611 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e4d52d00-6a7b-4b04-973b-4a91a1e83397 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:39:39.015798 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e4d52d00-6a7b-4b04-973b-4a91a1e83397 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:39.016323 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e4d52d00-6a7b-4b04-973b-4a91a1e83397 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:39.017100 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e4d52d00-6a7b-4b04-973b-4a91a1e83397 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:39.017541 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e4d52d00-6a7b-4b04-973b-4a91a1e83397 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:39.170118 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e4d52d00-6a7b-4b04-973b-4a91a1e83397 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:39:39.177954 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e4d52d00-6a7b-4b04-973b-4a91a1e83397 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1751 microversion: 2.1 time: 0.173855 May 17 17:39:39.178746 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 560/1070] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:39:39 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:39:40.195679 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-918e87b2-291f-4144-8bd9-9153f7c2d8a3 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:39:40.196374 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-918e87b2-291f-4144-8bd9-9153f7c2d8a3 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:39:40.202428 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-918e87b2-291f-4144-8bd9-9153f7c2d8a3 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:40.202871 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-918e87b2-291f-4144-8bd9-9153f7c2d8a3 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:40.203660 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-918e87b2-291f-4144-8bd9-9153f7c2d8a3 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:40.204090 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-918e87b2-291f-4144-8bd9-9153f7c2d8a3 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:40.343610 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-918e87b2-291f-4144-8bd9-9153f7c2d8a3 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:39:40.351536 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-918e87b2-291f-4144-8bd9-9153f7c2d8a3 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1756 microversion: 2.1 time: 0.161152 May 17 17:39:40.352090 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 511/1071] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:39:40 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:39:41.368318 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0e277830-108c-43f6-aa0b-411d0cb48bb3 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:39:41.368932 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0e277830-108c-43f6-aa0b-411d0cb48bb3 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:39:41.375238 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0e277830-108c-43f6-aa0b-411d0cb48bb3 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:41.375728 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0e277830-108c-43f6-aa0b-411d0cb48bb3 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:41.376495 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0e277830-108c-43f6-aa0b-411d0cb48bb3 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:41.376930 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0e277830-108c-43f6-aa0b-411d0cb48bb3 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:41.517410 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0e277830-108c-43f6-aa0b-411d0cb48bb3 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:39:41.525737 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0e277830-108c-43f6-aa0b-411d0cb48bb3 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1756 microversion: 2.1 time: 0.161300 May 17 17:39:41.526293 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 561/1072] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:39:41 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:39:42.542912 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f9d11bec-941c-4934-a305-c348c758d566 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:39:42.543476 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f9d11bec-941c-4934-a305-c348c758d566 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:39:42.549655 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f9d11bec-941c-4934-a305-c348c758d566 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:42.550128 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f9d11bec-941c-4934-a305-c348c758d566 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:42.550884 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f9d11bec-941c-4934-a305-c348c758d566 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:42.551316 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f9d11bec-941c-4934-a305-c348c758d566 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:42.690593 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f9d11bec-941c-4934-a305-c348c758d566 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:39:42.698452 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f9d11bec-941c-4934-a305-c348c758d566 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1756 microversion: 2.1 time: 0.159726 May 17 17:39:42.699013 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 512/1073] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:39:42 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:39:43.716073 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-89d70781-fe12-498a-bfd9-8d8d9274c9e4 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:39:43.717448 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-89d70781-fe12-498a-bfd9-8d8d9274c9e4 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:39:43.722934 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-89d70781-fe12-498a-bfd9-8d8d9274c9e4 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:43.723385 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-89d70781-fe12-498a-bfd9-8d8d9274c9e4 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:43.724187 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-89d70781-fe12-498a-bfd9-8d8d9274c9e4 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:43.725116 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-89d70781-fe12-498a-bfd9-8d8d9274c9e4 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:43.867241 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-89d70781-fe12-498a-bfd9-8d8d9274c9e4 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:39:43.875528 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-89d70781-fe12-498a-bfd9-8d8d9274c9e4 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1756 microversion: 2.1 time: 0.163276 May 17 17:39:43.876035 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 562/1074] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:39:43 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:39:44.894913 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-11a200c3-7867-4349-937d-c2772c011f11 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:39:44.894913 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-11a200c3-7867-4349-937d-c2772c011f11 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:39:44.900075 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-11a200c3-7867-4349-937d-c2772c011f11 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:44.900520 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-11a200c3-7867-4349-937d-c2772c011f11 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:44.901277 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-11a200c3-7867-4349-937d-c2772c011f11 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:44.901706 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-11a200c3-7867-4349-937d-c2772c011f11 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:45.040238 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-11a200c3-7867-4349-937d-c2772c011f11 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:39:45.047932 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-11a200c3-7867-4349-937d-c2772c011f11 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1756 microversion: 2.1 time: 0.159064 May 17 17:39:45.048487 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 513/1075] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:39:44 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 17:39:46.065035 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-65c8f34f-224d-4f48-8b34-150ce4e109ad tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:39:46.065704 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-65c8f34f-224d-4f48-8b34-150ce4e109ad tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:39:46.072011 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-65c8f34f-224d-4f48-8b34-150ce4e109ad tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:46.072464 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-65c8f34f-224d-4f48-8b34-150ce4e109ad tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:46.073232 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-65c8f34f-224d-4f48-8b34-150ce4e109ad tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:46.073670 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-65c8f34f-224d-4f48-8b34-150ce4e109ad tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:46.208928 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-65c8f34f-224d-4f48-8b34-150ce4e109ad tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:39:46.216625 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-65c8f34f-224d-4f48-8b34-150ce4e109ad tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1756 microversion: 2.1 time: 0.155513 May 17 17:39:46.217181 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 563/1076] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:39:46 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1756 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:39:47.233989 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d85b63d9-1457-4185-8ce8-4f65d896fa34 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:39:47.234623 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d85b63d9-1457-4185-8ce8-4f65d896fa34 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:39:47.241380 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d85b63d9-1457-4185-8ce8-4f65d896fa34 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:47.241827 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d85b63d9-1457-4185-8ce8-4f65d896fa34 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:47.242590 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d85b63d9-1457-4185-8ce8-4f65d896fa34 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:47.243026 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d85b63d9-1457-4185-8ce8-4f65d896fa34 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:47.384601 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d85b63d9-1457-4185-8ce8-4f65d896fa34 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:39:47.392292 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d85b63d9-1457-4185-8ce8-4f65d896fa34 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1756 microversion: 2.1 time: 0.162145 May 17 17:39:47.392843 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 514/1077] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:39:47 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:39:48.409017 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-809d40a0-e75f-490f-b372-88bd20221473 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:39:48.409647 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-809d40a0-e75f-490f-b372-88bd20221473 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:39:48.416739 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-809d40a0-e75f-490f-b372-88bd20221473 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:48.417190 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-809d40a0-e75f-490f-b372-88bd20221473 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:48.417956 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-809d40a0-e75f-490f-b372-88bd20221473 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:48.418393 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-809d40a0-e75f-490f-b372-88bd20221473 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:48.553952 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-809d40a0-e75f-490f-b372-88bd20221473 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:39:48.561678 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-809d40a0-e75f-490f-b372-88bd20221473 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1756 microversion: 2.1 time: 0.156574 May 17 17:39:48.562228 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 564/1078] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:39:48 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1756 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:39:49.578383 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-97737ced-aad8-48d0-85ac-ff1447fb20cf tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:39:49.579025 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-97737ced-aad8-48d0-85ac-ff1447fb20cf tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:39:49.585328 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-97737ced-aad8-48d0-85ac-ff1447fb20cf tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:49.585775 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-97737ced-aad8-48d0-85ac-ff1447fb20cf tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:49.586534 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-97737ced-aad8-48d0-85ac-ff1447fb20cf tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:49.586968 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-97737ced-aad8-48d0-85ac-ff1447fb20cf tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:49.725620 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-97737ced-aad8-48d0-85ac-ff1447fb20cf tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:39:49.733340 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-97737ced-aad8-48d0-85ac-ff1447fb20cf tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1756 microversion: 2.1 time: 0.158751 May 17 17:39:49.733891 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 515/1079] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:39:49 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:39:50.750944 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-09ebb1a2-a546-449b-bb25-b6350b9fc9b2 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:39:50.751575 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-09ebb1a2-a546-449b-bb25-b6350b9fc9b2 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:39:50.757827 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-09ebb1a2-a546-449b-bb25-b6350b9fc9b2 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:50.758274 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-09ebb1a2-a546-449b-bb25-b6350b9fc9b2 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:50.759033 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-09ebb1a2-a546-449b-bb25-b6350b9fc9b2 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:50.759467 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-09ebb1a2-a546-449b-bb25-b6350b9fc9b2 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:50.894912 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-09ebb1a2-a546-449b-bb25-b6350b9fc9b2 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:39:50.903230 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-09ebb1a2-a546-449b-bb25-b6350b9fc9b2 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1756 microversion: 2.1 time: 0.155850 May 17 17:39:50.903809 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 565/1080] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:39:50 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1756 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:39:51.921048 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-313414d5-d0ee-40cc-bcaf-9d461ef812fd tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:39:51.926507 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-313414d5-d0ee-40cc-bcaf-9d461ef812fd tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:39:51.928720 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-313414d5-d0ee-40cc-bcaf-9d461ef812fd tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:51.929172 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-313414d5-d0ee-40cc-bcaf-9d461ef812fd tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:51.929933 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-313414d5-d0ee-40cc-bcaf-9d461ef812fd tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:51.930409 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-313414d5-d0ee-40cc-bcaf-9d461ef812fd tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:52.066625 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-313414d5-d0ee-40cc-bcaf-9d461ef812fd tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:39:52.073112 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-313414d5-d0ee-40cc-bcaf-9d461ef812fd tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1756 microversion: 2.1 time: 0.155889 May 17 17:39:52.073679 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 516/1081] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:39:51 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1756 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:39:53.089984 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-05837bf8-6f2c-4872-bfae-5facfff11230 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:39:53.090585 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-05837bf8-6f2c-4872-bfae-5facfff11230 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:39:53.096908 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-05837bf8-6f2c-4872-bfae-5facfff11230 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:53.097377 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-05837bf8-6f2c-4872-bfae-5facfff11230 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:53.098127 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-05837bf8-6f2c-4872-bfae-5facfff11230 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:53.098564 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-05837bf8-6f2c-4872-bfae-5facfff11230 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:53.237762 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-05837bf8-6f2c-4872-bfae-5facfff11230 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:39:53.246000 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-05837bf8-6f2c-4872-bfae-5facfff11230 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1756 microversion: 2.1 time: 0.159880 May 17 17:39:53.246562 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 566/1082] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:39:53 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:39:54.262810 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-cb75cdb5-7120-4aed-b0b2-70442f9c18c7 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:39:54.263419 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-cb75cdb5-7120-4aed-b0b2-70442f9c18c7 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:39:54.269765 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cb75cdb5-7120-4aed-b0b2-70442f9c18c7 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:54.270215 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cb75cdb5-7120-4aed-b0b2-70442f9c18c7 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:54.270977 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cb75cdb5-7120-4aed-b0b2-70442f9c18c7 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:54.271410 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cb75cdb5-7120-4aed-b0b2-70442f9c18c7 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:54.407832 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-cb75cdb5-7120-4aed-b0b2-70442f9c18c7 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:39:54.416308 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-cb75cdb5-7120-4aed-b0b2-70442f9c18c7 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1756 microversion: 2.1 time: 0.157296 May 17 17:39:54.416871 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 517/1083] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:39:54 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1756 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:39:55.433854 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d7cc713d-75a6-47f4-8fb4-ab347ca32aba tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:39:55.434563 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d7cc713d-75a6-47f4-8fb4-ab347ca32aba tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:39:55.440789 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d7cc713d-75a6-47f4-8fb4-ab347ca32aba tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:55.441234 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d7cc713d-75a6-47f4-8fb4-ab347ca32aba tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:55.441997 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d7cc713d-75a6-47f4-8fb4-ab347ca32aba tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:55.442429 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d7cc713d-75a6-47f4-8fb4-ab347ca32aba tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:55.582958 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d7cc713d-75a6-47f4-8fb4-ab347ca32aba tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:39:55.590668 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d7cc713d-75a6-47f4-8fb4-ab347ca32aba tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1756 microversion: 2.1 time: 0.160641 May 17 17:39:55.591222 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 567/1084] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:39:55 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:39:56.607427 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-fb25f4ce-6223-444e-b79b-ed804dc78a15 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:39:56.608004 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-fb25f4ce-6223-444e-b79b-ed804dc78a15 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:39:56.614297 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fb25f4ce-6223-444e-b79b-ed804dc78a15 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:56.614741 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fb25f4ce-6223-444e-b79b-ed804dc78a15 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:56.616103 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fb25f4ce-6223-444e-b79b-ed804dc78a15 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:39:56.616536 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fb25f4ce-6223-444e-b79b-ed804dc78a15 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:39:56.752937 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-fb25f4ce-6223-444e-b79b-ed804dc78a15 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:39:56.760625 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-fb25f4ce-6223-444e-b79b-ed804dc78a15 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1759 microversion: 2.1 time: 0.157085 May 17 17:39:56.761176 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 518/1085] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:39:56 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1759 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:40:35.108876 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-9be3f107-e87c-4215-97f7-add0b752a860 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1320874333"}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:40:35.109534 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-9be3f107-e87c-4215-97f7-add0b752a860 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:40:35.115637 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9be3f107-e87c-4215-97f7-add0b752a860 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:40:35.116087 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9be3f107-e87c-4215-97f7-add0b752a860 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:40:35.116848 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9be3f107-e87c-4215-97f7-add0b752a860 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:40:35.117306 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9be3f107-e87c-4215-97f7-add0b752a860 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:40:35.241853 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.network.security_group_api [None req-9be3f107-e87c-4215-97f7-add0b752a860 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Removing security group d90055b2-1fb0-4e55-bd2a-3053d66d7837 from port 886f7c81-7ed2-4be0-9716-220ee11c6e8c May 17 17:40:35.902183 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-9be3f107-e87c-4215-97f7-add0b752a860 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "POST /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f/action" status: 202 len: 0 microversion: 2.1 time: 0.797304 May 17 17:40:35.905990 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 568/1086] 10.222.0.88 () {60 vars in 1277 bytes} [Tue May 17 17:40:35 2022] POST /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f/action => generated 0 bytes in 799 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:40:35.914063 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-bb883c7b-300b-4ea8-9147-89affbfe8e3a req-e80f6003-0622-416a-ab5f-bb7020f042e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84d4ef76-c06a-46c3-935a-925bf977545f", "tag": "886f7c81-7ed2-4be0-9716-220ee11c6e8c"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:40:35.922999 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-bb883c7b-300b-4ea8-9147-89affbfe8e3a req-e80f6003-0622-416a-ab5f-bb7020f042e6 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:40:35.923732 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-bb883c7b-300b-4ea8-9147-89affbfe8e3a req-e80f6003-0622-416a-ab5f-bb7020f042e6 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:40:35.942930 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-bb883c7b-300b-4ea8-9147-89affbfe8e3a req-e80f6003-0622-416a-ab5f-bb7020f042e6 service nova] Creating event network-changed:886f7c81-7ed2-4be0-9716-220ee11c6e8c for instance 84d4ef76-c06a-46c3-935a-925bf977545f on hv-cinder-84214 May 17 17:40:35.968051 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-bb883c7b-300b-4ea8-9147-89affbfe8e3a req-e80f6003-0622-416a-ab5f-bb7020f042e6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059366 May 17 17:40:35.968792 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 519/1087] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:40:37.260927 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0c79b367-b0e7-4c52-9b8c-62b16127fdf1 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:40:37.261458 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0c79b367-b0e7-4c52-9b8c-62b16127fdf1 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:40:37.267342 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0c79b367-b0e7-4c52-9b8c-62b16127fdf1 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:40:37.267831 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0c79b367-b0e7-4c52-9b8c-62b16127fdf1 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:40:37.268597 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0c79b367-b0e7-4c52-9b8c-62b16127fdf1 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:40:37.269033 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0c79b367-b0e7-4c52-9b8c-62b16127fdf1 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:40:37.348997 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-0c79b367-b0e7-4c52-9b8c-62b16127fdf1 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lazy-loading 'services' on Instance uuid 84d4ef76-c06a-46c3-935a-925bf977545f {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 17:40:37.571100 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0c79b367-b0e7-4c52-9b8c-62b16127fdf1 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "DELETE /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f/os-volume_attachments/7b097fd3-1537-44e3-80d5-5d5d262d29c4" status: 202 len: 0 microversion: 2.1 time: 0.314415 May 17 17:40:37.571728 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 569/1088] 10.222.0.88 () {58 vars in 1415 bytes} [Tue May 17 17:40:37 2022] DELETE /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f/os-volume_attachments/7b097fd3-1537-44e3-80d5-5d5d262d29c4 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:40:37.581461 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6d3da97c-7314-469e-ab61-861b16a1bac7 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:40:37.582545 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6d3da97c-7314-469e-ab61-861b16a1bac7 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:40:37.590141 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6d3da97c-7314-469e-ab61-861b16a1bac7 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:40:37.590678 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6d3da97c-7314-469e-ab61-861b16a1bac7 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:40:37.591458 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6d3da97c-7314-469e-ab61-861b16a1bac7 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:40:37.591913 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6d3da97c-7314-469e-ab61-861b16a1bac7 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:40:37.625108 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6d3da97c-7314-469e-ab61-861b16a1bac7 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048661 May 17 17:40:37.625760 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 520/1089] 10.222.0.88 () {58 vars in 1301 bytes} [Tue May 17 17:40:37 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:40:37.985101 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-fa02fe97-55f3-4b4c-8105-16c6df94d237 req-b5563863-7b5b-4cce-af2a-4ea8016654c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84d4ef76-c06a-46c3-935a-925bf977545f", "tag": "886f7c81-7ed2-4be0-9716-220ee11c6e8c"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:40:37.994179 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-fa02fe97-55f3-4b4c-8105-16c6df94d237 req-b5563863-7b5b-4cce-af2a-4ea8016654c3 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:40:37.994622 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-fa02fe97-55f3-4b4c-8105-16c6df94d237 req-b5563863-7b5b-4cce-af2a-4ea8016654c3 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:40:38.006036 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-fa02fe97-55f3-4b4c-8105-16c6df94d237 req-b5563863-7b5b-4cce-af2a-4ea8016654c3 service nova] Creating event network-changed:886f7c81-7ed2-4be0-9716-220ee11c6e8c for instance 84d4ef76-c06a-46c3-935a-925bf977545f on hv-cinder-84214 May 17 17:40:38.010888 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-fa02fe97-55f3-4b4c-8105-16c6df94d237 req-b5563863-7b5b-4cce-af2a-4ea8016654c3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029806 May 17 17:40:38.011505 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 570/1090] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 17:40:38.637777 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-778512cf-2ce9-4303-a4b2-18bd70135114 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:40:38.638774 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-778512cf-2ce9-4303-a4b2-18bd70135114 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:40:38.646087 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-778512cf-2ce9-4303-a4b2-18bd70135114 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:40:38.646538 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-778512cf-2ce9-4303-a4b2-18bd70135114 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:40:38.647306 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-778512cf-2ce9-4303-a4b2-18bd70135114 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:40:38.647777 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-778512cf-2ce9-4303-a4b2-18bd70135114 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:40:38.676423 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-778512cf-2ce9-4303-a4b2-18bd70135114 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042245 May 17 17:40:38.677002 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 521/1091] 10.222.0.88 () {58 vars in 1301 bytes} [Tue May 17 17:40:38 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:40:39.688338 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2ea6a820-f988-45cb-a05a-1dc114659376 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:40:39.689403 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2ea6a820-f988-45cb-a05a-1dc114659376 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:40:39.695947 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2ea6a820-f988-45cb-a05a-1dc114659376 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:40:39.696393 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2ea6a820-f988-45cb-a05a-1dc114659376 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:40:39.697155 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2ea6a820-f988-45cb-a05a-1dc114659376 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:40:39.697590 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2ea6a820-f988-45cb-a05a-1dc114659376 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:40:39.725144 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2ea6a820-f988-45cb-a05a-1dc114659376 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041068 May 17 17:40:39.725694 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 571/1092] 10.222.0.88 () {58 vars in 1301 bytes} [Tue May 17 17:40:39 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 17:40:39.735363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-61af7001-3379-4ef9-9a6f-6bedc90a1b69 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:40:39.735894 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-61af7001-3379-4ef9-9a6f-6bedc90a1b69 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:40:39.742131 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-61af7001-3379-4ef9-9a6f-6bedc90a1b69 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:40:39.742585 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-61af7001-3379-4ef9-9a6f-6bedc90a1b69 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:40:39.743357 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-61af7001-3379-4ef9-9a6f-6bedc90a1b69 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:40:39.743834 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-61af7001-3379-4ef9-9a6f-6bedc90a1b69 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:40:39.814884 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-61af7001-3379-4ef9-9a6f-6bedc90a1b69 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] HTTP exception thrown: Instance 84d4ef76-c06a-46c3-935a-925bf977545f is not attached to volume 7b097fd3-1537-44e3-80d5-5d5d262d29c4 May 17 17:40:39.817251 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-61af7001-3379-4ef9-9a6f-6bedc90a1b69 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Request method failure captured: May 17 17:40:39.817251 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: DELETE /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f/os-volume_attachments/7b097fd3-1537-44e3-80d5-5d5d262d29c4 HTTP/1.1 May 17 17:40:39.817251 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:40:39.817251 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:40:39.817251 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:40:39.817251 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:40:39.817251 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:40:39.817251 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:40:39.817251 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:40:39.817251 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:40:39.817251 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig92JZCctMa9HV1Lg1Boy49kGC_Qt5odoI4wAfH6gg4wmATXxtHPckOopeG4PaSf0EMgTeW7ldaH2wi5OVLXkt4askSr7qalzQ0R2kXpNtQDfVbKt9VnNGZ5uf_ccgBXFtRH7MVFqW5IZXPJStBIIsXCLqq_c9CZq6A0kWtfqFh-KAh4 May 17 17:40:39.817251 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:40:39.817251 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:40:39.817251 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:40:39.817251 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:40:39.817251 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:40:39.817251 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:40:39.817251 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: ca1ed85649da40dd85a30986f4837161 May 17 17:40:39.817251 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-TestMinimumBasicScenario-444747140 May 17 17:40:39.817251 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:40:39.817251 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:40:39.818966 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ca1ed85649da40dd85a30986f4837161"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ca1ed85649da40dd85a30986f4837161"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ca1ed85649da40dd85a30986f4837161"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ca1ed85649da40dd85a30986f4837161", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:40:39.818966 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-TestMinimumBasicScenario-444747140 May 17 17:40:39.818966 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: ca1ed85649da40dd85a30986f4837161 May 17 17:40:39.818966 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-TestMinimumBasicScenario-444747140 May 17 17:40:39.818966 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-TestMinimumBasicScenario-444747140-project May 17 17:40:39.818966 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:40:39.818966 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:40:39.818966 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 71c7edd9b03e4b389ab09c0ac3a366e4 May 17 17:40:39.818966 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-TestMinimumBasicScenario-444747140-project May 17 17:40:39.818966 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:40:39.818966 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Instance 84d4ef76-c06a-46c3-935a-925bf977545f is not attached to volume 7b097fd3-1537-44e3-80d5-5d5d262d29c4 May 17 17:40:39.819934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'server_id': '84d4ef76-c06a-46c3-935a-925bf977545f', 'id': '7b097fd3-1537-44e3-80d5-5d5d262d29c4'} May 17 17:40:39.819934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:40:39.819934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:40:39.819934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 17 17:40:39.819934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 17 17:40:39.819934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 17:40:39.819934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 17:40:39.819934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 17 17:40:39.819934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 17 17:40:39.819934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7b097fd3-1537-44e3-80d5-5d5d262d29c4. May 17 17:40:39.819934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:40:39.819934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:40:39.819934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:40:39.819934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:40:39.819934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:40:39.819934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:40:39.819934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:40:39.819934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:40:39.819934 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:40:39.821509 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:40:39.821509 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 17 17:40:39.821509 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 17 17:40:39.821509 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84d4ef76-c06a-46c3-935a-925bf977545f is not attached to volume 7b097fd3-1537-44e3-80d5-5d5d262d29c4 May 17 17:40:39.821509 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:40:39.821509 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:40:39.821509 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:40:39.821509 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:40:39.821509 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:40:39.821509 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:40:39.821509 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:40:39.821509 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:40:39.821509 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84d4ef76-c06a-46c3-935a-925bf977545f is not attached to volume 7b097fd3-1537-44e3-80d5-5d5d262d29c4 May 17 17:40:39.821509 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:40:39.821509 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-61af7001-3379-4ef9-9a6f-6bedc90a1b69 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Returning 404 to user: Instance 84d4ef76-c06a-46c3-935a-925bf977545f is not attached to volume 7b097fd3-1537-44e3-80d5-5d5d262d29c4 {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:40:39.822708 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-61af7001-3379-4ef9-9a6f-6bedc90a1b69 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "DELETE /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f/os-volume_attachments/7b097fd3-1537-44e3-80d5-5d5d262d29c4" status: 404 len: 154 microversion: 2.1 time: 0.087279 May 17 17:40:39.822708 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 522/1093] 10.222.0.88 () {58 vars in 1415 bytes} [Tue May 17 17:40:39 2022] DELETE /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f/os-volume_attachments/7b097fd3-1537-44e3-80d5-5d5d262d29c4 => generated 154 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:40:41.072969 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b3c2355e-ac26-4039-a865-6aa34dc8e080 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:40:41.073572 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b3c2355e-ac26-4039-a865-6aa34dc8e080 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:40:41.079851 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b3c2355e-ac26-4039-a865-6aa34dc8e080 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:40:41.080293 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b3c2355e-ac26-4039-a865-6aa34dc8e080 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:40:41.081050 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b3c2355e-ac26-4039-a865-6aa34dc8e080 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:40:41.081480 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b3c2355e-ac26-4039-a865-6aa34dc8e080 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:40:41.105542 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b3c2355e-ac26-4039-a865-6aa34dc8e080 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Going to try to terminate instance {{(pid=117612) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 17:40:41.376878 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b3c2355e-ac26-4039-a865-6aa34dc8e080 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "DELETE /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 204 len: 0 microversion: 2.1 time: 0.307292 May 17 17:40:41.377371 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 572/1094] 10.222.0.88 () {58 vars in 1238 bytes} [Tue May 17 17:40:41 2022] DELETE /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 17:40:41.390037 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f0dd25f4-a3ba-46b2-9ee3-3539714ece47 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:40:41.390674 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f0dd25f4-a3ba-46b2-9ee3-3539714ece47 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:40:41.397629 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f0dd25f4-a3ba-46b2-9ee3-3539714ece47 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:40:41.398070 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f0dd25f4-a3ba-46b2-9ee3-3539714ece47 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:40:41.398830 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f0dd25f4-a3ba-46b2-9ee3-3539714ece47 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:40:41.399258 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f0dd25f4-a3ba-46b2-9ee3-3539714ece47 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:40:41.523637 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f0dd25f4-a3ba-46b2-9ee3-3539714ece47 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:40:41.530867 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f0dd25f4-a3ba-46b2-9ee3-3539714ece47 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1553 microversion: 2.1 time: 0.144627 May 17 17:40:41.531424 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 523/1095] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:40:41 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1553 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:40:42.548799 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6e324e34-683d-4cfa-8c7c-0232ffefaf69 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:40:42.549415 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6e324e34-683d-4cfa-8c7c-0232ffefaf69 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:40:42.555699 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6e324e34-683d-4cfa-8c7c-0232ffefaf69 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:40:42.556145 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6e324e34-683d-4cfa-8c7c-0232ffefaf69 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:40:42.556899 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6e324e34-683d-4cfa-8c7c-0232ffefaf69 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:40:42.557376 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6e324e34-683d-4cfa-8c7c-0232ffefaf69 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:40:42.683202 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6e324e34-683d-4cfa-8c7c-0232ffefaf69 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:40:42.690614 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6e324e34-683d-4cfa-8c7c-0232ffefaf69 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1553 microversion: 2.1 time: 0.146165 May 17 17:40:42.691174 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 573/1096] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:40:42 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:40:43.708749 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-2f69ead1-64ab-405f-b63f-ffd71ffa90f1 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:40:43.710202 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-2f69ead1-64ab-405f-b63f-ffd71ffa90f1 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:40:43.717019 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2f69ead1-64ab-405f-b63f-ffd71ffa90f1 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:40:43.717867 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2f69ead1-64ab-405f-b63f-ffd71ffa90f1 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:40:43.718318 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2f69ead1-64ab-405f-b63f-ffd71ffa90f1 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:40:43.718747 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2f69ead1-64ab-405f-b63f-ffd71ffa90f1 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:40:43.827701 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2f69ead1-64ab-405f-b63f-ffd71ffa90f1 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c7edd9b03e4b389ab09c0ac3a366e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1ed85649da40dd85a30986f4837161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 17 17:40:43.830203 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-dc0ebafd-2187-4f86-ba44-7dc305d0ccc9 req-c9257cb7-d02b-42ce-a2ef-7b8bcfaf2c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84d4ef76-c06a-46c3-935a-925bf977545f", "name": "network-vif-deleted", "tag": "886f7c81-7ed2-4be0-9716-220ee11c6e8c"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 17:40:43.836280 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-2f69ead1-64ab-405f-b63f-ffd71ffa90f1 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 200 len: 1511 microversion: 2.1 time: 0.132065 May 17 17:40:43.845659 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 524/1097] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:40:43 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 1511 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 17:40:43.845828 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-dc0ebafd-2187-4f86-ba44-7dc305d0ccc9 req-c9257cb7-d02b-42ce-a2ef-7b8bcfaf2c94 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:40:43.845828 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-dc0ebafd-2187-4f86-ba44-7dc305d0ccc9 req-c9257cb7-d02b-42ce-a2ef-7b8bcfaf2c94 service nova] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:40:43.851374 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-dc0ebafd-2187-4f86-ba44-7dc305d0ccc9 req-c9257cb7-d02b-42ce-a2ef-7b8bcfaf2c94 service nova] Creating event network-vif-deleted:886f7c81-7ed2-4be0-9716-220ee11c6e8c for instance 84d4ef76-c06a-46c3-935a-925bf977545f on hv-cinder-84214 May 17 17:40:43.856183 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-dc0ebafd-2187-4f86-ba44-7dc305d0ccc9 req-c9257cb7-d02b-42ce-a2ef-7b8bcfaf2c94 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029666 May 17 17:40:43.856742 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 574/1098] 10.222.0.88 () {64 vars in 1317 bytes} [Tue May 17 17:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 17:40:44.853489 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c4f0fb34-1eaa-438b-bb42-51ec6ca583ea tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:40:44.854033 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c4f0fb34-1eaa-438b-bb42-51ec6ca583ea tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] [instance: 84d4ef76-c06a-46c3-935a-925bf977545f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 17:40:44.860341 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c4f0fb34-1eaa-438b-bb42-51ec6ca583ea tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:40:44.860781 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c4f0fb34-1eaa-438b-bb42-51ec6ca583ea tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:40:44.861536 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c4f0fb34-1eaa-438b-bb42-51ec6ca583ea tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 17:40:44.861965 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c4f0fb34-1eaa-438b-bb42-51ec6ca583ea tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Lock "598e0022-4d13-47ae-9073-352b20e59bd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 17:40:44.875847 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-c4f0fb34-1eaa-438b-bb42-51ec6ca583ea tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] HTTP exception thrown: Instance 84d4ef76-c06a-46c3-935a-925bf977545f could not be found. May 17 17:40:44.877363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c4f0fb34-1eaa-438b-bb42-51ec6ca583ea tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Request method failure captured: May 17 17:40:44.877363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f HTTP/1.1 May 17 17:40:44.877363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 17 17:40:44.877363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 17 17:40:44.877363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Connection: close May 17 17:40:44.877363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 17 17:40:44.877363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 17 17:40:44.877363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.88 May 17 17:40:44.877363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 17 17:40:44.877363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 17 17:40:44.877363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABig92JZCctMa9HV1Lg1Boy49kGC_Qt5odoI4wAfH6gg4wmATXxtHPckOopeG4PaSf0EMgTeW7ldaH2wi5OVLXkt4askSr7qalzQ0R2kXpNtQDfVbKt9VnNGZ5uf_ccgBXFtRH7MVFqW5IZXPJStBIIsXCLqq_c9CZq6A0kWtfqFh-KAh4 May 17 17:40:44.877363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 17 17:40:44.877363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 17 17:40:44.877363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 17 17:40:44.877363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 17 17:40:44.877363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 17 17:40:44.877363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 17 17:40:44.877363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Id: ca1ed85649da40dd85a30986f4837161 May 17 17:40:44.877363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-TestMinimumBasicScenario-444747140 May 17 17:40:44.877363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Role: reader,member May 17 17:40:44.877363 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Roles: reader,member May 17 17:40:44.879806 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ca1ed85649da40dd85a30986f4837161"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ca1ed85649da40dd85a30986f4837161"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ca1ed85649da40dd85a30986f4837161"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ca1ed85649da40dd85a30986f4837161", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}] May 17 17:40:44.879806 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-TestMinimumBasicScenario-444747140 May 17 17:40:44.879806 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: ca1ed85649da40dd85a30986f4837161 May 17 17:40:44.879806 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-TestMinimumBasicScenario-444747140 May 17 17:40:44.879806 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User: tempest-TestMinimumBasicScenario-444747140-project May 17 17:40:44.879806 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 17 17:40:44.879806 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 17 17:40:44.879806 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Id: 71c7edd9b03e4b389ab09c0ac3a366e4 May 17 17:40:44.879806 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-TestMinimumBasicScenario-444747140-project May 17 17:40:44.879806 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: method: > May 17 17:40:44.879806 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: exception: Instance 84d4ef76-c06a-46c3-935a-925bf977545f could not be found. May 17 17:40:44.879806 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: action_args: {'id': '84d4ef76-c06a-46c3-935a-925bf977545f'} May 17 17:40:44.880770 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 17:40:44.880770 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:40:44.880770 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 17:40:44.880770 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 17:40:44.880770 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 17:40:44.880770 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 17:40:44.880770 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 17:40:44.880770 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 17:40:44.880770 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 17:40:44.880770 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 17:40:44.880770 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84d4ef76-c06a-46c3-935a-925bf977545f could not be found. May 17 17:40:44.880770 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:40:44.880770 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:40:44.880770 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:40:44.880770 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:40:44.880770 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:40:44.880770 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:40:44.880770 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 17:40:44.880770 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 17:40:44.880770 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 17:40:44.882368 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 17:40:44.882368 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 17:40:44.882368 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 17:40:44.882368 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 17:40:44.882368 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 17:40:44.882368 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 17:40:44.882368 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 17:40:44.882368 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84d4ef76-c06a-46c3-935a-925bf977545f could not be found. May 17 17:40:44.882368 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:40:44.882368 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 17:40:44.882368 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:40:44.882368 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 17:40:44.882368 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 17:40:44.882368 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 17:40:44.882368 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 17:40:44.882368 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 17:40:44.882368 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84d4ef76-c06a-46c3-935a-925bf977545f could not be found. May 17 17:40:44.882368 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 17 17:40:44.883821 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c4f0fb34-1eaa-438b-bb42-51ec6ca583ea tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Returning 404 to user: Instance 84d4ef76-c06a-46c3-935a-925bf977545f could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 17:40:44.883821 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c4f0fb34-1eaa-438b-bb42-51ec6ca583ea tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f" status: 404 len: 111 microversion: 2.1 time: 0.029356 May 17 17:40:44.883821 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 525/1099] 10.222.0.88 () {58 vars in 1235 bytes} [Tue May 17 17:40:44 2022] GET /compute/v2.1/servers/84d4ef76-c06a-46c3-935a-925bf977545f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 17:40:44.888613 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-def31e32-1500-4b5a-ad07-f28ca1be1da0 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] Calling method '.version_select at 0x7f73d49c5790>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 17:40:44.995169 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-def31e32-1500-4b5a-ad07-f28ca1be1da0 tempest-TestMinimumBasicScenario-444747140 tempest-TestMinimumBasicScenario-444747140-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-456264398" status: 202 len: 0 microversion: 2.1 time: 0.110736 May 17 17:40:44.995777 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 575/1100] 10.222.0.88 () {58 vars in 1268 bytes} [Tue May 17 17:40:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-456264398 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 17:42:16.885731 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 17:42:16.886446 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Tue May 17 17:42:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 17:42:44.375981 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 17:42:44.376504 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Tue May 17 17:42:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 17:43:42.552307 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 17:43:42.553094 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Tue May 17 17:43:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 17:43:44.638126 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 17:43:44.639384 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Tue May 17 17:43:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 17:43:57.889713 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 17:43:57.890430 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Tue May 17 17:43:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 17:45:36.897992 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 17:45:36.897992 dv-cinder-842142-1-iscsi devstack@n-api.service[117612]: Tue May 17 17:45:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 17:45:55.707612 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 17:45:55.708129 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Tue May 17 17:45:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 17:46:04.383817 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 17:46:04.384365 dv-cinder-842142-1-iscsi devstack@n-api.service[117611]: Tue May 17 17:46:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!